As Vermont’s state government takes its first baby step into the giant world of open data, the state’s civic hackers are lining up to help.
Harry Bell of Vermont’s Department of Information and Innovation announced Tuesday that the state would be stepping out of its website shell and into the “open data” movement — a growing international trend toward making government data more available to the public.
In line with principles of “proactive disclosure,” which makes public information freely available before anyone has to ask for it, open data is the product of a systematic methodology that seeks to catalog, structure, unify and publish as much government data as possible.
At an Open Data Consortium in Montpelier Tuesday afternoon, coordinated by the Vermont Center for Geographic Information, Bell described his job as using the Internet to facilitate communication between the state and the rest of the world. To date, that communication has consisted of a hodgepodge system of websites, most cut off from each other by separate back-ends and proprietary formats.
“The rest of the state’s interaction with open data kind of starts with last week on Tuesday,” Bell said.
And he wasn’t kidding.
The state signed a contract the first week of October to publish 10 data sets on a new Web-based portal. The nature of the contract — tiny compared to full-fledged open data endeavors — marks a substantial progression beyond the state’s scattered and hesitant forays into making public records available online.
To the civic hackers, software developers, website designers and state government workers attending the consortium, the news resonated like a pending sea change in the way the government and people of Vermont communicate and work together for public good.
Open data vision
VTDigger is underwritten by:
“Open data should be the mantra” of state government, one attendee suggested.
His comments helped kick off a wide-ranging discussion that followed three hours of presentations by a diverse lineup of panelists from the government, corporate and civic hacker communities.
“But they have finite money and time,” countered keynote speaker John Cohn, an IBM fellow in corporate technical strategy and a self-confessed newcomer to open data. “Can we give some input to the state?”
The cost of open data is not just temporal and financial, but also political, an employee from the Agency of Agriculture added. She said her office faces a strong constituency of people who do not want the agency posting its data online.
“There’s a strong privacy lobby in this state,” she warned.
VCGI’s outreach coordinator, Leslie Pelch, who organized the consortium, observed a generational gap in some of the polar opposite approaches being voiced.
“We can’t dismiss that,” she said. “We are going to have to deal with the fact that there is this expectation” of total openness among the younger generation.
Within a half-hour, the roughly two dozen people remaining from the afternoon established that long-term cultural and operational change in the government’s approach to data would require incremental progress and a collaborative attitude on the part of the public.
And patience. And prioritization. And their help.
“If you can show a demand and anticipate value,” Cohn said. With a gray shock of frizzy hair on a balding head, he looks something like a mad scientist.
“If we could say, here’s three kinds of data we’d really like to see and here’s how we’re going to use it,” he continued, warming up. “Especially if we could offer the tech support to do it!” The idea caught fire.
Another presenter, Jim Duncan of the Vermont Monitoring Cooperative, said Massachusetts estimates it saves $2 million on Freedom of Information requests state employees no longer have to respond to: The information is proactively “open” and the public can peruse a catalog of data on its own. Duncan qualified, however, that he didn’t know the methodology by which the state arrived at that figure.
Code for BTV’s Bradley Holt chimed in. “It’s not just interesting things we’re going to do,” he contributed to the hypothetical conversation now taking place between the hackers and agency officials. “But what we’re going to do furthers the mission of your agency!”
Pelch kept the idea rolling. “That would be an interesting hack-a-thon,” she said with a smile. “Pair the state agency people with hackers.”
Within minutes, the next open data event was conceived, before the group had even decided whether they should create an email listserv or a Web-based forum to keep their conversation going.
Opening the state’s data
Excitement aside, Bell emphasized in his talk that several barriers exist before the state can commit fully to open data.
One challenge that may be more significant for Vermont than other states, he said, is the “legacy” information systems currently employed. In other words, the antiquated state of Vermont’s information technology architecture.
“Most of Vermont’s systems were built well before (data sharing) was even a concept,” Bell said. Much of the state’s data is still “locked up” in mainframe computers, a legacy that will take significant time and resources to overcome.
“There would have to be considerable modernization in various systems to make that even possible,” Bell cautioned.
Privacy concerns will be tricky to navigate, too. Trevor Lewis, a records analyst from the Secretary of State’s archives and records administration, said public records law has not kept pace with the notion of “practical obscurity.”
For a great many records, privacy arguments are a moot point because the records themselves are so obscure that they’re never made public. But digitization and data access unlock a “mosaic effect” that brings together previously unseen or disconnected pieces of information. When viewed or analyzed in relation to one another, new information can be gleaned about the potentially private matters of the people at the heart of those data.
Fear of misuse is another worry, Duncan said. Open data means that information is free to be used in any way, even if its analysis is either unintentionally or nefariously misleading.
The demand for proven, quantifiable benefits to justify the cost of opening data is another common barrier governments must overcome, he said.
Additionally, the concept of open data — predicated as it is on electronic government operations — is distinct from the aim of establishing “e-goverment” systems. “They overlap but they’re not the same thing, and mixing those two can sink an open data effort,” Duncan emphasized.
Bell said the pilot project is intended to be just a proof of the concept to “get things rolling.” If successful, the goal simply will be to continue moving forward. Success will be measured, in part, by how well the state’s geographic information systems and financial data can interface with the open data platform.
The company Socrata holds the one-year contract, worth about $12,000, Bell said.
Three of the first 10 data sets to be “opened” have already been chosen from the existing Spotlight on Fiscal Transparency website, Bell said. They show expenditures to various vendors and data about state salaries, he said.
And he’s taking nominations for the remaining data sets to be used as guinea pigs.
“If you’re aware of state data sets you’d like to see exposed, feel free to share your ideas,” he said. Bell’s email address is [email protected]
“Before the year is up, we’ll make a decision about how to proceed, assuming the pilot is successful.”
Correction: This article was corrected on Friday, Oct. 11, 2013 to correct the spelling of Leslie Pelch’s name and reflect that some comments came from an employee at the Agency of Agriculture.
Missing out on the latest scoop? Sign up here to get a weekly email with all of VTDigger's reporting on politics. And in case you can't get enough of the Statehouse, sign up for Final Reading for a rundown on the day's news in the Legislature.