As I said when I posted on open data earlier this year:

It’s not about the technology. It’s not about data quality. Or privacy. Or commercial sensitivity, or any of that stuff. That should all be dealt to as part of the everyday functioning of any administration. It is about accepting that we, the government, collect and manage this information on behalf of citizens and that it is our fundamental responsibility to make it available to them in a way that supports the creation of public and economic value.

The open data site is a very positive step forward in that direction.

A not so positive step forward; indeed, more a cautionary tale for public sector managers, is the headlong rush to capitalize on the positive engagement that open government initiatives are triggering around the world. It is genuinely difficult to understand the emergence of cardigan chic, but it is a phenomenon nonetheless. Transforming government is a business that everyone wants to be in; from social media consultants whose experience in the sector can be measured in a page full of tweets to corporations blinded by a sense of their own beneficence…

Adobe’s Open Gov site is an alarming example of the latter. The site is 100% Flash based. It’s like building a website to promote philanthropy — and charging people to view the content. The site is intended to:

promote the use of Adobe technologies to achieve the goal of “opening up Washington,” as well as highlighting ways in which federal, state, and local governments have implemented these technologies. Ars Technica

Publishing data in proprietary formats alone, or as the primary media, is a very bad idea. It does not lead to openness, it does not lead to transparency and it most certainly isn’t in the public interest. As the Sunlight Foundation rightly point out:

if the data format has an ® by its name, it probably isn’t great for transparency or open data. Sunlight Labs

Currently, sixty-seven percent of New Zealand public sector agencies hold some information that they can no longer access. Publishing agency data in proprietary formats is only going to exacerbate that issue…

DIA should be applauded for building the open data catalogue. It is an important step in opening up government information. It is, however, only one step. Agencies should be looking at registering their data sets, but they should also be looking at using open standards for that data.

By way of a disclosure, I have provided a small amount of advice to DIA about this project, but certainly not enough to prevent me commending the initiative (or sufficient for me to legitimately bask in any reflected approbation).

Photo: Swiv

Recently, Glen Barnes and Nat Torkington launched the Open Data Catalogue and it is encouraging to see how much government data has been submitted in such a short space of time. There are currently more than fourty data sets on the site, from central and local government agencies. These sets range from economic data provided by the Treasury, geospatial data, various sets of energy data and a collection of directories and registers.

The point to bear in mind as you scroll down this list, though, is that these sets represent a fraction of the data the Crown holds. This catalogue could easily extend to hundreds of pages…

So, while we celebrate the initiative of the Ministry for the Environment releasing data under a Creative Commons license, for example, it might be worth pausing and considering how we can accelerate this process.

That conversation is already taking place on the Open Government Ninjas List, where one of the threads has been about the barriers to opening up government data.

While I agree that most of these reasons have some currency, none resonate as much as the senior American official talking to John Geraci of O’Reilly:

There were some interesting apps in there, but overall they didn’t meet with the mayor’s agenda for the city.
Open Gov Is a Dialogue, Not a Monologue

This (completely guileless?) admission underscores for me what is the critical issue in opening up government data: culture change.

It’s not about the technology. It’s not about data quality. Or privacy. Or commercial sensitivity, or any of that stuff. That should all be dealt to as part of the everyday functioning of any administration. It is about accepting that we, the government, collect and manage this information on behalf of citizens and that it is our fundamental responsibility to make it available to them in a way that supports the creation of public and economic value.

This isn’t an add-on, or a ‘nice to do.’ It’s an integral part of our operating environment now.

There is an Open Data BarCamp planned for later this year. Come along and be part of the change.

Photo: Justin Marty

To recap, the concept of open sourcing government is essentially about allowing third parties (citizens, companies, non-profits, etc.,) direct access via APIs to government data, so:

that individuals, communities and businesses are able to interact with government web applications in ways that are useful to them.
5 principles for Govt 2.0

The UK Cabinet Office released a report in June last year that looked at what this would mean for their public management system. The economic impact alone, as the report makes clear, had the potential to make a significant contribution:

2006 figures from the Office of Fair Trading that estimate that improved availability of information to re-users could double the direct market value of public sector information to £1.1 billion per year.
The value of government information

The Princeton paper authors, however, seem to be going some way further, calling for the US federal government to reduce the role it plays in presenting online information to citizens. The authors argue that the key role for federal agencies should be opening up their data, rather than building websites that provide a platform (and by inference, not a particularly good one) and a filter for people to access the information.

Their premise is an attractive one. That government

should focus on creating a simple, reliable and publicly accessible infrastructure that “exposes” the underlying data. [... The Government should] require that federal websites themselves use the same open systems for accessing the underlying data as they make available to the public at large.
Government Data and the Invisible Hand, p1.

Effectively, this means that government agencies could focus their attention (and taxpayer dollars) on the quality and accessibility of the information, and not on the presentation level. It’s a compelling proposition, particularly when you consider the current state of the namespace (in any jurisdiction, really).

The authors argue that the market, in the form of these third parties developing applications that reuse the government data, will drive economies of innovation and accessibility that are beyond anything that government itself could hope to provide. They list some of these advanced features:

• advanced search
• RSS feeds
• links to information sources
• mashups with other data sources
• discussion forums and wikis
• data visualization
• automated content and topic analysis
• collaborative filtering and crowdsourcing analysis

It is worth pointing out that some of these advanced features are already part of the namespace here; albeit with mixed success. Advanced search, RSS feeds, and wikis are all essential elements of the .govt.nz space.

There are a couple of concerns that I have. The authors acknowledge that in some case there will be no private actor willing to step forward and create a compelling website based on the data. The notion that government makes all information accessible, irrespective of it’s apparent value, is a fundamental one. Abrogating that responsibility to third parties seems fraught with potential to disadvantage some sections of the community. Mike W leaves a comprehensive comment to this effect on Ed Felten’s blog (one of the authors of the paper).

As an aside, ensuring that people can access a government data set via a visualization (like EveryBlock, for example) using a screenreader can be done, but it is hard work…

More of a concern, however, is the notion that we can either continue to try to build usable websites or simply outsource innovation in the namespace. I don’t see, as the authors apparently do, that the two are mutually exclusive. Indeed, there is an argument that government should retain and build more capability for innovation, rather than adopt practices that would encourage this sort of activity to atrophy.

Those concerns aside, however, what the authors of the paper are proposing is both an effective and efficient approach to transformed government. We should be seriously considering the same here in New Zealand.

Photo: kool_skatcat

Social media release?

This is a media release that is tailored for a world where the environment in which media operate has changed significantly over the last couple of years. Tools like search engines, RSS and social media have together created an online space where news is syndicated and aggregated in ways that make it almost ambient.

The Social Media Release is intended to make it easier on people to identify and share the most important pieces of information with others around the globe while adding their own valuable perspective and/or editorial. It also takes full advantage of HTML, multimedia and the network effects enabled by the Internet by using structured data via the Microformat, which ultimately increases its findability by interested parties – which is ultimately the driving purpose of public relations and the press release specifically.
Chris Heuer

Microformats?

Microformats are simple, standard formats for semantically marking up information, making that information easier to discover and share. Perhaps the best known microformat is hCard, the format for contact information. Using an open data format for this information means that it is discoverable by people and by machines. hCard information can be downloaded and easily saved into your existing contact book, like Outlook or Thunderbird and – more importantly – it can be searched, indexed and syndicated by machines (browsers, web crawlers or custom scripts).

You can see microformatted information in action on Upcoming.org, a social events calendar that spiders and presents hCalendar information, or on Flickr, where all the personal profiles are stored in hCard.

The social media release group are proposing a microformat for media releases, hRelease.

So what?

For public sector communicators there are probably at least two salient points. One, the development of the template and the microformat are a good indication that we should be paying attention to the elements of the format, if not putting out releases this way ourselves: can you really see Ministry X putting out a release with a digg this! link at the bottom?

Two, microformats have tremendous potential. With the launch of the new search technology in 2007, we will have the power not just to index HTML pages, but elements of those pages. So, for example, we could index all the published hCard information in the .govt namespace and then republish/syndicate it any number of ways. Same with hCalendar, or hResume for www.jobs.govt.nz.

By using open data formats, we transform the way government information is published, discovered and shared. It is published once, from an authoritative source, and then can be syndicated and repackaged inside and outside government. It means we stop thinking of government websites as a single repository for agency specific information, and start seeing those sites as part of the publishing vehicle for all-of-government information. Another piece in the mosaic…

That is starting to sound like transformed government to me. Your thoughts?