One indication of how powerful it is comes from the following article:

Places allows your friends to tag you when they check in somewhere, and Facebook makes it very easy to say “yes” to allowing your friends to check in for you. But when it comes to opting out of that feature, you  are only given a “not now” option (aka ask me again later). “No” isn’t one of the easy options.

This warning doesn’t come from a computer security forum, the EFF, or a group of interested hackers. It comes from the ACLU, the groundbreaking organization that aims to protect Americans’ civil rights. In other words, Facebook privacy is now being watched by the same group pushing for the closure of Guantanamo Bay. A powerful place to be – but perhaps an indication that Zuckerberg needs to re-assess his take on privacy?

In some ways, it doesn’t matter. Software projects like Status.net and Cliqset (Youtube link) are establishing a resilient, decentralized network where privacy is in users’ hands by default. These new applications are easy to use, accessible and ready for both private individuals and enterprises to pick up – and as such, represent the real future of social data on the web.

Related entries

• Building the user-centered web (8)
• What Facebook users want (0)
• User control on the open web (9)

Last week, the State of New York passed a bill that bans short-term rentals: specifically, no homeowner or renter may sublet their home for less than a month. The target is sites like AirBNB, an up and coming website that allows travelers to eschew pricey hotels – and their accompanying hotel room occupancy tax – in favor of private homes.

If the governor chooses to pass the legislation (as opposed to veto it), AirBNB will effectively be outlawed, and with it, a grassroots marketplace economy for short-term accommodation. New York State will have cemented hotels and bed & breakfasts as gatekeepers to the city for travelers who can’t stay with friends or relatives.

To me, this is an interesting reaction: it shows, once again, that established gatekeepers are terrified of the Internet. We’re used to that by now in the context of media content – we already know that newspapers, publishers, record companies and movie distributors aren’t as important as they were – but this is a scarcity-driven marketplace. It used to be that finding a safe, clean room in a strange city was a hard problem, so we turned to hotels as a trusted source. Running a hotel is in itself an expensive, tough business, and as a result there were a limited number in any given city, and the price went up according to demand. Although the hotel business is a ruthless game, it’s always been hotels competing with other hotels.

Now, though, we can visit websites like AirBNB and Couchsurfing, where private citizens can offer their homes to travelers, and the site will let us know who we can trust based on other peoples’ experiences. The marketplace has been blown wide open, and it turns out that a lot of us would rather go for a cheaper, friendlier option. I wouldn’t put money on New York blotting out short sublets for long.

Power to the people

We’re going to be seeing a lot more of this, in all kinds of market sectors. We’re already seeing ridesharing sites become popular, for example, blowing up the market previously owned by taxicabs and making it available to anyone who happens to be driving somewhere. Effectively this formalizes hitchhiking, making it both safer and more efficient.

It all comes down to one simple rule: People want to be free.

The Internet is opinionated: as a medium, it inherently works to empower people and eliminate hierarchies in society. It shouldn’t be a surprise that the most popular Internet companies hail from California; their philosophies are direct descendents of the civil rights activism that took place there in the sixties and seventies. In many cases, it’s even the same people. (Or – and here I put up my hand as the son of Berkeley “radicals” – their children.)

Gatekeepers – companies, structures or processes that act as exclusive barriers or filters – are not long for this world. Where gatekeepers exist, they do so because the alternative was inconvenient at the time when the gatekeeper became established – not because they’re inherently better than an empowered population. Those organizations, companies, and even governments, need to look at themselves very carefully and figure out what needs to be changed, before those things are changed for them.

Most Commented Posts

• Gender differences on the new frontier (16)
• Writing in Oxford? (16)
• End of an era, start of a new one (12)

• The Open Rights Group ad is not asking you to vote against the Bill. It is asking you to debate it thoroughly, as it has profound implications for how digital business is done in Britain.
• The Creative Coalition Campaign ad is asking you to vote “yes” to the Bill without a proper debate.

Some people have incorrectly painted the argument against the Digital Economy Bill as one perpetuated by illegal file-sharers. It’s not; most of us believe, as the Creative Coalition Campaign does, that piracy is wrong. However, we also believe in due process and the excellent principles which have formed the bedrock of British law for centuries.

The Internet is fast becoming an important medium for participating in society. The government recognizes this, and has sponsored its own UK Online centres, which aim to get more people online. More and more resources have been made available online, using excellent sites like Data.gov.uk, which aims to spark innovation using existing governmental data.

However, the Digital Economy Bill contains some clauses which may cause someone’s Internet access to be removed without due process, thereby disenfranchising them from these opportunities. It also contains further clauses which may block websites on a national level, which undermines the decentralized principle on which the Internet works, and brings British policy in line with China. Collectively, these clauses may make it difficult to run public Internet access points in places like coffee shops and universities, and put Internet businesses based in Britain at a distinct disadvantage to their equivalents in countries like the United States.

These are complex issues. The needs of rights-holders are important, and a clear message must be sent that piracy is wrong. However, by using such broad brush strokes to do so, we are in danger of undermining the Internet itself, disenfranchising voters, and turning British digital businesses into second-class citizens on the global stage. A debate is vital.

Yours sincerely,

Ben Werdmuller
And millions of others.

Related entries

• The Digital Economy Bill: an open letter (4)

Here in the UK, the Digital Economy Bill looks like it’s set to be rushed through Parliament:

There’s plenty to oppose in the Digital Economy Bill, it gives the government the ability to disconnect millions. Schools, libraries and businesses could see their connection cut if their pupils, readers of customers infringe any copyright. But one group likes it, the music industry. In a leaked memo a few days ago they admitted the only way to get the bill through would be to rush it through without a real parliamentary debate. Let’s stop that happening.

According to the Open Rights Group, there have even been questions about the Bill’s compatibility with the Human Rights Act.

The following is a letter I wrote to my MP, Andrew Smith. If you’re a British resident, I recommend you do the same (Boing Boing has a sample letter, but generally it’s a good idea to avoid form letters if you can).

Dear Andrew Smith,

I’m very worried that the Government is planning to rush the Digital Economy Bill into law without a full Parliamentary debate. Despite claims made by the BPI and others, I believe it will have dire consequences for British businesses, and therefore for the economy as a whole.

In short, the Digital Economy Bill provides the mechanism to arbitarily remove anyone’s freedom to communicate – their Internet connection, and potentially access to their website or servers – without due process. This will immediately put us on an uneven footing with countries such as the United States, who are already well ahead of us in terms of digital business. If Britain is to remain competitive in the digital world, this must not go ahead.

This is not to say that piracy should be allowed. It is undeniably a criminal act. However, for an issue that has become so culturally ingrained that it requires precise tactics to undo, these measures are unsubtle and counterproductive.

At the very least, a proper Parliamentary debate must be had.

As a constituent I am writing to you today to ask you to do all you can to ensure the Government doesn’t just rush the bill through and deny us our democratic right to scrutiny and debate. As a digital professional, I would be delighted to help with any questions you might have.

Kind regards,

Ben Werdmuller
ben@benwerd.com

Want to read the Bill for yourself? Here it is.

Related entries

• Dear Member of Parliament, (1)

At launch, Data.gov.uk has nearly 3,000 data sets available for developers to build mashups with. The U.S. site, Data.gov, has less than 1,000 data sets today.

[…][Unlike the US equivalent, the site] includes 22 military data sets at launch, including one called Suicide and Open Verdict Deaths in the U.K. Regular Armed Forces.

However, these are raw datasets. As Paul Clarke points out, the site only pays lip service to openness until someone comes along and turns these sets into useful reports and applications:

The only test of real success is: use. Not usefulness. Not theoretical use. Real use. Getting beyond the novelty application, the demonstrator, and the hobby lies at the heart of really untapping the potential of data.gov.uk.

Indeed, the figures that Techcrunch Europe report suggest that turning this data into something useful may be harder than it sounds:

So far over 2,400 developers have registered to test the site and provide feedback, [while] 10 applications have been created.

I left a comment on Paul Clarke’s post pointing out some potential pitfalls that may inhibit innovation, including the government’s insistence on licensing the data under Crown Copyright and their impartiality regarding Twitter. There’s also been some criticism around the lack of a common data format for each feed (although the RDF triple proudly displayed on the front page suggests this is likely to change).

Nonetheless, I believe this represents a huge step forward. Turning raw materials into useful, compelling applications that improve the users’ quality of life requires a huge amount of creativity and talent, and providing the data feeds in the first place is a crucial first step.

You can list all the available datasets here.

Related entries

• The mechanics of "open" (0)
• Public IT project hell: let’s make government work for us (1)
• Direct messaging in a social web architecture (3)

For most of the 20th century, we paid for our news, entertainment, art and literature. We allowed businesses to act as gatekeepers for this content, and accepted that the media landscape would be dictated by decisions made in the boardroom. Publishers, movie studio bosses, broadcasters and record company executives dictated what we read, saw and heard, based on financial projections. Their opinions about what was commercially viable regulated supply. Content had a price.

This situation was dictated by economic scarcity. That is to say, not only did an original work, such as a novel or a movie, cost money to produce, but each item used to distribute it, such as a book or a DVD, had its own individual cost of production. To make money, a publishing house or a movie studio needed to recoup its initial production costs for the original work, as well as the per-item cost for each book or DVD. The exception to this in the media landscape was broadcast media – television and radio – which anyone could watch for free, in exchange for a regular advertising break. However, in both distributed and broadcast media, the content needed to be commercial enough to either attract buyers or advertisers. In order to recoup the production cost. the companies involved controlled what was released according to what they thought would sell. As a result the market for content was led by supply – what the content companies deemed worthy of release – rather than consumer demand.

The first continuously-published American newspapers launched in April, 1704. Since then, their philosophy of objective journalism has played an important part in American culture. For democracy to function, a citizen must understand the facts surrounding an issue, so they can vote on it in an informed way: access to impartial information is key. One New York resident remarked in the 1840s that “one thing is certain – nowhere will you find better informed people – that is, those who better understand all the principal movements of the day, whether political, moral or religious, than the readers of a country newspaper”. As the primary method for disseminating facts and information to the public, newspapers have been fundamental to democracy.

In the first decade of the 21st century, the model for distributing newspaper content changed. In 2008, newspaper circulation in the US dropped by 4.6% on weekdays and 4.8% on Sundays. Meanwhile, visits to the top fifty news-related websites, which all are free to access, increased by 27%. Correspondingly, the first quarter of 2009 was the worst ever for newspapers, with sales plunging by $2.9 billion.

The seeds of the Internet were sewn in 1969. However, it wasn’t until Tim Berners-Lee invented the World Wide Web in 1989 that its effects on the media began to be felt. While content had been made available on the network for twenty years, it had been purely text-based, required a level of technological knowhow to operate, and needed to be accessed through specialist communications software. The Web was based on hypertext, a more accessible way of joining documents and articles together through linked topics and phrases. Most importantly, though, it brought with it the Web browser, a single portal for accessing all content, and allowed the use of embedded images, movies and sound.

In 1992, the Internet was opened for commercial access, and online services like AOL, Prodigy and Delphi began offering connectivity. Anyone could run a site on the Web, which was now accessible to millions of people worldwide. In 1993, Global Network Navigator became the first online publication to support itself with interactive advertising banners, and the path forward was clear: newspapers could make their content available for free to anyone in the world with Internet access, and pay for it with advertising. Due to the nature of the network, once a piece of content had been produced, the cost of disseminating it indefinitely was negligible. The barrier to entry had also been dramatically lowered: anyone could publish news without having to establish a distribution network. Other advertising-supported sites like the Drudge Report, the Huffington Post and opinion-orientated “Web logs” like DailyKos began to spring up. The former media gatekeepers were no longer an effective part of the news ecosystem.

These events moved newspaper content beyond the scarcity model. Wikipedia says this about scarcity: “Goods that are scarce are called economic goods. […] Other goods are called free goods if they are desired but in such abundance that they are not scarce, such as air and seawater”. Thanks to the Internet, content became like air and seawater: almost infinitely abundant, and free. The possibilities provided by Internet advertising seemed to have heralded a new era.

Internet advertising has a major benefit over its printed cousin: it can be targeted towards its audience, and statistics about advertisement effectiveness and reader engagement can be captured in real time. Advertisers know exactly how many people have responded with an advertisement, and can tailor it to a particular viewing demographic. Contrast that with the print medium, where by necessity everyone must see the same advertisements, and advertisers must make inferences from the newspaper’s readership statistics and their own sales to determine an advertisement’s effectiveness. It should be no surprise that in addition to its $2.9 billion in lost sales, print advertising sales in American newspapers declined by $7.5 billion in 2008.

Given its theoretical superiority, the loss of newspaper advertising revenue in print should have been made up for online. However, this is not the case. Scarcity provided a captive market: often there were only one or two newspapers available in any particular location. Suddenly, with the advent of the Web, there were tens of thousands of titles available everywhere. As a result, what had previously been a supply-constrained readership that read a relatively small number of sources fragmented into a demand-driven one that read articles in the most convenient way to them, from whichever source was most conveniently available. Competition for readers had become fierce, and the abundance of publications willing to host advertising meant that prices were much lower.

Furthermore, a lot of advertising that had traditionally been placed in newspapers was now being cannibalized by new, specialized websites like Craigslist and Monster.com. As New York University’s Clay Shirky notes, these new companies “all have the logic that if you want to list a job or sell a bike, you don’t go to the place that’s printing news from Antananarivo and the crossword puzzle. You go to the place that’s good for listing jobs and selling bikes.” Newspapers, or even their associated websites, were no longer hubs for local information. People were visiting specialized sources for each kind of information they needed.

Shirky also points out that the alignment of advertising and journalism was always going to be short-lived: “the commercial success of newspapers and their linking of that to accountability journalism wasn’t a deep truth about reality. Best Buy was not willing to support the Baghdad bureau because Best Buy cared about news from Baghdad. They just didn’t have any other good choices.” In other words, the advertising attention they received was because they were the only, rather than best, option. As soon as the Internet opened up more efficient avenues, the money flowed away.

To replace this vacuum, some newspapermen are attempting to rebuild a captive audience through other means. Rupert Murdoch, the head of News International (the multinational news corporation that owns the Fox News Channel, the Wall Street Journal and the New York Post, among others), announced in the summer of 2009 that he would begin charging for access to all of his newspaper’s online content, from the Wall Street Journal right down to the Sun. With it, they will also ban readers from electronically sharing content with their friends, which is a kind of social word-of-mouth marketing that has driven readership levels in recent years. As Chase Carey, News International’s Chief Operating Officer, puts it: “we believe customers value quality journalism. We need to get paid for our product as it shifts to the digital world.”

Murdoch’s announcement sent a strong signal to the rest of the newspaper industry, and split commentators down the middle. Consumers, after all, were now used to getting their content for free. Both the music and movie industries had been having a very difficult time convincing their customers to purchase rather than pirate their wares. On the other hand, it was clear that making content free and advertising-supported was not delivering the revenue that publishers had been expecting. Variety, the entertainment trade newspaper, had experimentally made all its content available for free online in 2006. Although their website’s readership flourished, advertising dollars did not appreciably increase. On December 17, 2009, the “pay wall,” as website pages demanding payment for content are known, was re-established.

Indeed, a recent decision by the Dallas Morning News to bring its editorial department under the control of its advertising sales division (brought to my attention by Paul Adrian of Press for the People) would seem to support the idea that news content should be directly paid for. The old supply-driven model allowed editorial departments to maintain journalistic integrity: companies might have been ticked off by a newspaper article, but where else could they place their advertising? However, in today’s multi-source media, the loss of a valuable advertising contract is a very real possibility. The situation at the Dallas Morning News may help ensure the newspaper’s longevity, but it results in subjective journalism that is at the whim of overriding commercial concerns. Arguably, the only way forward for objective journalism is to charge the people who value it.

However, serious questions are being asked about the viability of this route. In particular, how willing will people be to pay for content, even from a trusted newspaper, now that there are thousands of competitors giving it away for free online? “When we look at why people quit buying the newspaper, it’s overwhelmingly because ‘I can get it for free online,’” notes William Dean Singleton, the CEO of the fourth-largest American newspaper company, MediaNews. It may not be possible to force an artificial scarcity in news reporting without all newspapers charging for it at the same time – something that would require widespread collusion in the industry. With the exception of reporting niches like finance, where, according to Shirky, “data is valuable in inverse proportion to its availability (unlike editorials, say, or political reporting),” most consumers prefer to receive their content for free. In the mainstream, Shirky suggests, “the key questions for the average publisher contemplating pay walls are: How serious will that competition be? How many users will you lose? Will banning sharing create a defensible advantage? And the answers are: crushing, most, and no.”

How, then, will objective journalism survive? One emerging suggestion is that we must de-couple journalism from newspapers. We may have to accept that the latter may become extinct in order to save the former. After all, it’s the factual reporting and analysis that are valuable to our society, rather than the bundles of low-grade paper they are printed on. I would argue that those things, when provided in a thoughtful way that makes full use of current technology, are worth paying for.

As O’Reilly Publishing’s online editor Kurt Cagle puts it: “When a previously thriving industry seems to be dying, it is most likely because the services that it initially provided are becoming obsolete. It is better in this situation to rethink what such services should provide, then build a niche for it. Otherwise, you’re just wasting money.”

It’s an open question, and one I intend to help address in 2010.

Related entries

• For your consideration at SXSW Interactive (1)
• PubCasts: subscribe to publications through RSS (1)
• File sharing and digital business models (1)

Johannes Ernst contrasts the Yahoo/Facebook deep integration announcement with the US government’s announcement that they will spend $235 million on integrating incompatible healthcare IT systems, and asks some pertinent questions:

I assume we all agree that an environment in which leading-edge companies innovate on their own to the benefit of their customers is better than one in which the government has to spend large amounts of money to drag along kicking and screaming “participants” — as it is so common in health IT. How do we turn US healthcare IT from the latter to the former?

One might equally substitute education, or local councils, or law enforcement. It’s a widely-accepted truth that public IT endeavors suck, and that enforcing data standards across disparate public bodies is like herding confused, angry cats into a very wet bag. It’s also true that commercial web services have been very good at integrating for the good of their customers, often without any money (let alone $235 million) changing hands.

I do think there’s a false distinction that’s been made here: public bodies and government departments tend to be swamped in a sea of bureaucracy that prevents them from moving or changing as nimbly as many commercial companies. (Of course, as companies begin to become institutionalized through age and size, they also become less nimble: take Microsoft and IBM.) Many of these restrictions are necessary for the simple reason that they’re using our money, and some regulation is required to ensure tax funds are being spent wisely and benefit the wider public good. We don’t want people to just walk off with it.

Our tax dollars at play

It’s also widely-accepted that our tax dollars are not spent wisely, and often don’t benefit the wider public good. Public bodies are full of inefficiencies, in part because of the bureaucracy involved. I’ve certainly worked within university environments where entire departments of people could reasonably be described as incompetent, but had integrated themselves so well into the system that they had become a required port of call in the bureaucratic workflow. I’ve also seen fully private companies formed using university money and resources earmarked for public research, and government grants essentially spent on beer and travel. These are the kinds of inefficiencies and sanctioned fraud that must be stamped out.

Public bodies and private companies are different in one major respect: their stakeholders. It is a legal requirement for shareholders in a company to have access to the company returns, board minutes and so on (although a wider cloak of privacy is often necessary). In a public body, the stakeholders are the public, yet we often don’t have access to details like financial statements, minutes and decision-making rationale. In Britain, an attempt to get government departments to work like commercial companies has resulted in a ridiculous system where departments must pay each other and the British taxpayer often doesn’t have a legal right to the information they produce.

The public is the board

Ultimately, in a democracy, the public should be the board of directors. Genuine public oversight hasn’t been possible before, but transparency and accountability are now possible via the Internet. We don’t need political parties and administrations to be our eyes and ears any more; we need them to be our hands, and act on our behalf. We need to be able to see the inner workings of public bodies: not just the numbers, but the actual internals and decisions. With genuine public oversight in a way that ensures the bodies know they’re being watched, and governments obligated to maintain these bodies for direct public benefit in a way that’s responsive to the public, costs should go down. It’s not perfect – and Switzerland has recently shown us the dangers of having frequent public referendums – but given the spending, inefficiency and fraud inherent in the system, we can no longer trust the government to do this on our behalf.

Related entries

• Open data at data.gov.uk (1)
• Building the user-centered web (8)
• The mechanics of "open" (0)

Then, if you’re a US citizen, head over to the Save the Internet Campaign and sign their petition to congress to preserve net neutrality. Also see FreePress’s links on how some telecoms companies are artificially skewing the debate and presenting the false impression of a grassroots movement against net neutrality.

(Still confused about what net neutrality is? Wikipedia has a great overview.)

Most Commented Posts

• Gender differences on the new frontier (16)
• Writing in Oxford? (16)
• End of an era, start of a new one (12)

During the first year of the two-year study, student achievement increased 27.5 percent, according to Whithaus, who is principal investigator of a study to evaluate the project’s effectiveness.

Computer use – and particularly, online community engagement – increases engagement with formal learning, which is great news for the e-learning software market. But I’m particularly interested in the effect of networks on informal learning – specifically, learning from our activities on the web.

Learning happens when two sets of experiences and assumptions are exposed with each other – in other words, when we communicate. The web is the most globally efficient communications method the world has ever seen, and as a result, I believe, may rapidly transform our world culture for the better.

Last month, I met with J. Nathan Matias from the World University Project, a project that aims to evolve higher education by shedding light on how people learn and teach around the world. His intent is to highlight experiences that people in the west have largely not been exposed to, and in so doing advance mutual understanding between our academic systems. It’s a brilliant idea, which takes advantage of the potential of a universally accessible global communications network.

Recently, the Iranian election swamped Twitter, to the point where they rescheduled maintenance in order to minimize the effect on dissidents in the country. Suddenly, because Iranian dissidents were online and conversing with people from the west, Iran seemed less like a scary, far-off country filled with terrorists and more like – gasp – a country filled with actual human beings. Clay Shirky had this to say:

I’ve been thinking a lot about the Chicago demonstrations of 1968 where they chanted “the whole world is watching.” Really, that wasn’t true then. But this time it’s true … and people throughout the world are not only listening but responding. They’re engaging with individual participants, they’re passing on their messages to their friends, and they’re even providing detailed instructions to enable web proxies allowing Internet access that the authorities can’t immediately censor. That kind of participation is really extraordinary.

On a smaller scale, we’re now interacting with people from other walks of life, with markedly different sets of skills and interests, on a daily basis. The opportunity available to us is not just to get our message out on an unprecedented scale – but to get other peoples’ messages in, and in the process make ourselves more educated and informed than we’ve ever been. On a personal level, it can help us with our fourth grade homework; on a societal level, it’s a revolution.

Related entries

• Internet addiction and online learning environments (0)
• Using game dynamics to drive participation (2)
• Reflecting on 2009 (1)

On a not-entirely-unrelated note, I want to make you aware of GlobalVoices Advocacy, which aims to create a global anti-censorship network of bloggers and online activists in the developing world. This is important work; one of the really exciting aspects of the web is the way information can spread and undermine oppressive legislation. It’s also dangerous, as blogging in places where freedom of speech is not protected can have severe consequences. They provide tutorials on blogging anonymously, as well as blogging effectively for a cause.

Zemanta, a blogging tool that suggests content to include as you type, is offering a small funding award to the charitable cause that gets the most posts as part of their ‘blogging for a cause’ promotion. It’s a good idea, and if you like what GlobalVoices Advocacy do, maybe you could write about them too – or any other good cause that you think is deserving.

I vote for Global Voices Advocacy because freedom of speech and the fight against censorship is one of the most important fronts in the fight for human rights around the world. This is a fight that we can all participate in, without having to go through governments, and GlobalVoices Advocacy is one organization that shows us how.

This blog post is part of Zemanta’s "Blogging For a Cause" campaign to raise awareness and funds for worthy causes that bloggers care about.

Related entries

• BarCamp Transparency (1)
• BarCamp Transparency posters and the cult of openness (0)
• Notes from BarCamp Oxford (4)

But it shouldn’t need to exist.

In the US, federal government-created maps (and other data) are considered to be public information, and released freely. In the UK, such maps are subject to Crown Copyright, and the Ordnance Survey has been set up as a trading organisation that legally must make money from its efforts.

This was an archaic idea at its inception, but makes even less sense now. The economy is in dire straits, and what it should be doing is providing taxpayer-funded data for use by companies; this kind of data in particular could give British businesses a flying start. Instead, it chooses to make money from them instead, and web services are left to projects like OpenStreetMap, as well as US businesses like Google, in order to source information.

The Guardian’s Data Store is one British attempt to rectify the situation, but ideally all data in the public interest should be released in a format that is easily consumable by third-party applications. As well as helping entrepreneurs and small businesses, it’ll allow for a deeper understanding of, and participation in, how our country is run. Which can’t be a bad thing – can it?

Related entries

• Direct messaging in a social web architecture (3)
• Activity Streams and OAuth: a social web architecture (3)
• How social networks can replace email (11)

It’s in its early planning stages, but it’ll take place sometime over the summer here in Oxford. If you’re interested, I suggest you take a look at the BarCamp Transparency wiki and throw your name into the ring. I was asked if I’d help organise, and while I can’t provide as much time as I’d like to due to prior commitments, I’ve volunteered to discuss openness in social media, provide web resources and help out with the event itself.

Transparency is hugely important, and becoming more so. As citizens we have more and more demands upon us to surrender our privacy and aspects of our civil liberties, but the government and politicians on all sides have been reluctant to provide more oversight into their activities. Meanwhile, social technologies have the power to enable us to find and share public information, organise ourselves into groups, and have more say in how our country is run.

This is a vital event that already sounds very promising indeed.

Related entries

• Supporting freedom of speech (0)
• Open data at data.gov.uk (1)
• Public IT project hell: let’s make government work for us (1)

It turns out they’ve decided they don’t need all the features you’d find in a traditional file system (emphasis mine):

Traditional file systems are governed by the POSIX standard governing metadata and access methods for each file. These file systems are designed for access control and accountability within a shared system. An Internet storage system written once and never deleted, with access granted to the world, has little need for such overhead.

It would be nice if someone from Facebook could confirm that they do, in fact, have the ability to physically delete a photo or other items of data, and that this does, in fact, happen on the back end if you ask it to.

From what we understand of Facebook’s architecture, it probably doesn’t. When you post something, it gets copied and broadcast to your friends’ feeds; the data is out there forever. Even when you delete an account, your details aren’t fully removed. Surely, if nothing else, this is a legal minefield for the company?

Related entries

• Building the user-centered web (8)
• Social networking: beyond the silo (1)
• User control on the open web (9)

• Female population of the world: 49.8%
• Female population of Facebook: 55%
• Female population of social networks as a whole: 54.7%
• Percentage of people awarded undergraduate computer science degrees by PhD-granting institutions in the US and Canada in 2006-7 who were women: 12%

While social media usage is skewed ever so slightly towards women, a whopping 88% of the people who study to learn the skills to build these tools are men. This is at a time when, in science generally, women receiving undergraduate degrees are increasing as a percentage year on year.

Some of the reasons for this have been covered a lot over the past year. This 2007 interview with Aaron Swartz (who worked on Creative Commons and is now behind the awesome government site Watchdog.net) contains some interesting thoughts on discrimination on the basis of both gender and race:

If you talk to any woman in the tech community, it won’t be long before they start telling you stories about disgusting, sexist things guys have said to them. It freaks them out; and rightly so. As a result, the only women you see in tech are those who are willing to put up with all the abuse.

[...] The denial about this in the tech community is so great that sometimes I despair of it ever getting fixed. [...] It’s an institutional problem, not a personal one.

Last year, Chris Messina called out a BusinessWeek article for disproportionately featuring the male participants at Web2Open, a Web 2.0 technology unconference Tara Hunt had predominantly organized. He followed it up this month with another post about the Future of Web Apps as a white boys’ club:

Turns out, white men also don’t have the monopoly on the best speakers – even in the tech industry – yet their ilk continue to make up a highly disproportionate number of the folks who end up on stage. And that means that good content and good ideas and important perspectives aren’t making it into the mix that should be, and as a result, audiences are getting short-changed.

This isn’t just about technology, and it isn’t just about the commercial web. We’re in an era where everything is going online; Barack Obama would arguably not be President of the United States without his engagement with grassroots social media technologies, and he is certainly continuing to embrace them into his Presidency. Yet if those technologies are effectively controlled by a minority of the population, that population’s biases and predispositions seep into how they’re designed, how they’re built, and ultimately how they work in practice.

Although I’ve picked out gender here, the same is doubtless true regarding race and sexuality discrimination in the tech sector, although the numbers haven’t been as widely published. As computing becomes more and more important in society as a whole, it becomes more and more important to ensure the people who help shape it are selected fairly and represent a cross-section of the people it serves.

Update: Lots of really interesting links in the comments, including Katie Piatt’s recommendation of Ada Lovelace Day, which encourages people to blog about women in tech.

Meitar Moscovitz points me to Will the Semantic Web Have a Gender?, a ReadWriteWeb article from last year about the possibility that the semantic web will reflect a predominantly male attitude to the world.

Image by mouton.rebelle and released under a CC-Attribution-Noncommercial license.

Related entries

• The mechanics of "open" (0)

That was five years ago. The world is only now beginning to catch up.

The Silicon Valley Web community is buzzing with “open” ideas: data portability, the open stack, the open mesh, OpenID, OAuth, and so on. There have been two Data Sharing Summits, a bunch of Identity Workshops, and efforts are crystallizing around open activity streams, contacts sharing, and virtually anything else you might want to transfer between web applications. David Recordon, co-creator of OpenID and all-round cheerleader for openness, has predicted that Facebook won’t be a walled garden by 2010.

This is fantastic stuff, which I intend to get even more involved with as the year progresses. Good work is happening all round, and even sleepy behemoths like Microsoft are beginning to take notice.

What worries me slightly is that the work is centered around the Silicon Valley community, and within that is largely built with public-facing commercial websites in mind. Those sites (like Digg, MySpace, the SixApart properties and so on) are awesome without a doubt, but the potential of social technologies falls well beyond the commercial web. People are beginning to use them on intranets, within universities, across governmental departments and so on – places that could use the same approaches, but need to be represented in the discussions.

Their exclusion is not the fault of the people producing the standards and doing this great work; they’re very happily welcoming anyone with a productive contribution to the table. Instead, it falls to those organizations to realize what they’re missing out on and begin to pay more attention to cutting edge technology. The Obama administration is certainly waking up to this, but others – notably the UK government – are extremely reticent to embrace anything open at all.

The technology is falling into place to allow for an open, transparent, knowledge-orientated economy. Now it’s time to look at what else is needed.

Related entries

• Open data at data.gov.uk (1)
• Public IT project hell: let’s make government work for us (1)
• User control on the open web (9)

Essentially, marketing your ideas – what Greg euphemistically calls “getting someone to listen to your iPod” – comes down to providing an emotional reason for them to listen to you and buy into what you’re saying. This lecture is a great starting point for thinking about how to do that, and provides lots of food for thought.

Most Commented Posts

• Gender differences on the new frontier (16)
• Writing in Oxford? (16)
• End of an era, start of a new one (12)

[...] Obama’s rise to the presidency will be studied for years to come as the textbook example of a new kind of electioneering driven by people and technology, says Ralph Benko, a principal of the political consulting firm Capital City Partners, in Washington, D.C.

“It was a peer-to-peer, bottom-up, open-source kind of ethos that infused this campaign,” says Benko. “Clearly, there was a vision to this.”

Certainly, Obama was the first candidate to have really “got” the Internet, but there was something different about this campaign: the Internet got Barack Obama. Sure, he released video statements on the web, had a Twitter account, engaged ordinary people through personal publishing and raised a phenomenal amount of money by asking for individual donations. These things alone are historic. But it’s what ordinary people and unrelated organizations went and did next that may have tipped the election.

Social media is viral by nature. You share something with your friends, who (if they enjoy it or find it of use) pass it along to their friends, and so on, creating an exponential network effect. Great content spreads quickly, but with the added benefit that it always comes via a source you trust, so you’re probably more likely to pay attention to it. That’s why it’s so attractive to marketers, and why the Obama campaign chose to harness it.

However, there’s another side to the coin. You lose control of your message; all you can do is set the ball rolling in the right direction, keep putting out your own content, and hope for the best. The campaign did this intelligently; the photo to the top right of this post is one of 50,435 and counting made available under a Creative Commons license from the Barack Obama Flickr account. The Creative Commons license allows anyone to share or adapt the photos as long as attribution is listed and the work isn’t for commercial gain.

In this case, due to a combination of factors (not least the fact that George W Bush is the least popular President since Nixon after Watergate), it snowballed. Obama didn’t campaign negatively, but there was plenty of negative press about the incumbent, John McCain and Sarah Palin flying around, in large part due to the efforts of bloggers and political organizations who put their materials out on the web.

One of the most effective videos was this one, which took the characters and actual cast of Budweiser’s Wassup ads and updated them for the Bush era. It’s unrelated to the Obama campaign, but has been viewed almost 4.5 million times at the time of writing:

In effect, Obama could take the high ground, knowing that information about the Republican administration and the candidates would surface. That’s one of the most powerful aspects of the web, the network effect ensuring that important information found its way into the hands of voters. (Not to mention allowing me to see the US TV coverage, and therefore make a more informed decision as an absentee voter.) As time goes on, the web becomes more ubiquitous and social functionality finds its way into all kinds of software, it’s going to be much harder for information to be suppressed. That’s one of the things that keeps me passionate about this field; I can see the very real benefits for real people.

And the meme continues. My favourite post-election site so far is Ze Frank’s from 52 to 48 with love, which echoes the Obama campaign’s unity theme.

Photo by Barack Obama, under a Attribution-Noncommercial-Share Alike 2.0 Generic CC license.

Most Commented Posts

• Gender differences on the new frontier (16)
• Writing in Oxford? (16)
• End of an era, start of a new one (12)

I spend a lot of my time thinking about how Internet technology can promote information flow, and through it efficiency and transparency, in peoples’ lives. When you’re allowing people to publish their opinions and experiences, and then share them in the kind of social mesh that the web is becoming, I think it’s also important to remember to somehow include the people who aren’t part of the mesh, and whose circumstances mean that they can’t possibly participate. The danger is that people who aren’t active in the network will lose out, and be underrepresented in important ways.

This clearly doesn’t matter much in the consumer web, but I believe that the principles proved in the social web will take greater hold in software, and through that to society as a whole. We are becoming more democratic; we have more access to information. Anyone can publish an idea, a news report, a photograph or any other piece of transmittable media, which can then propagate to anyone else. The roots are in web technology, but the effect is clearly felt way beyond the tech sphere; we’re fast getting used to this privilege, but for most of history freedom of expression has been a radical idea.

Ideally, the result of this freedom through technology is a real-life social mesh, more closely-bound on a global level than people have ever been in the past. Through the free flow of information comes transparency, and through that, again, democracy. But this ideal can only work, in my opinion, if everyone feels the benefit. Part of the point of democracy, surely, is that everyone can take part.

So how can we extend the network? And should it even be an issue, given that around 2.6 billion people don’t have access to basic sanitation?

It’s a fact that cellphone penetration massively outstrips computers in the developing world, which is one reason why a lot of very large computing names are beginning to focus on handsets (and why the free, open source Android software that Google is peddling has nothing to do with competing with the iPhone). That means that cellphone networks also have a great deal more reach than other forms of network in those areas, and it’s therefore significant that the next generation of ultra mobile PCs – for example the next Eee PC – have connectivity through the cellphone network built-in. The result, I hope, will be a sea change in Internet demographics; from that, I hope many things will follow.

These are my interests. I want to bring the technologies that have been proven on consumer websites and in the tech sphere to places where they can benefit people, and make the offline world a better place. I’m under no delusions that I’m going to have any effect myself, but as the technical head of an open source social networking engine, and as someone who just has a personal interest, I can try and do my bit.

This blog is going to be for the sorts of thoughts – like this post – which don’t lend themselves well to a company-sponsored space. It’s often going to be rambly, and will probably raise more questions than answers. Still, you’ve got this far, which hopefully means I won’t be shouting into the void. Thanks for reading; please let me know what you think.

Most Commented Posts

• Gender differences on the new frontier (16)
• Writing in Oxford? (16)
• End of an era, start of a new one (12)