This is the (rough) text of a talk I gave at the British Computer Society (BCS) Location Information Specialist Group’s 3rd annual addressing update seminar in August 2016. There were more jokes in person. And some Pikachu. The slides for my talk are also online as are those for Ant Beck’s talk . Hi, I’m Peter. I do some stuff at the (ODI). The ODI was founded three years ago. It’s mission is to connect, equip and inspire people around the world to innovate with data. Its headquarters are in the UK but it works around the . Open Data Institute world I’m here to talk about open addresses in the UK. To understand the tale it’s useful to start off with a (shortened) bit of history. Ancient history… Addresses and other types of geospatial data were early targets for releases. They are vital datasets that make it possible to build many, many services and products. Way back in 2006 to ask the UK government to “give us back our crown jewels”. They pointed out the complex arrangements for address data and how the data was sold to fund those complex arrangements. They even pointed out the issues it generated for the 2001 census. open data Charles Arthur and Michael Cross wrote in the Guardian maintaining In and in 2010 government said that . Victory! 2009 the UK government announced that Tim Berners-Lee, one of the ODI’s founders, was going to help it open up data postcodes and address data were going to be early releases Some of the tales from 2013 But it was a pyrrhic victory. Whilst released many thousands of datasets the promised address data was not one of them. In 2013 the Royal Mail was privatised along with its rights to help create and sell that address data. The complex arrangements that were pointed out in 2006 just got more complex. And, in the meantime, . government another census happened with the inevitable, and costly, need to build another new address list The , and probably got a bit angry. . They kept working to make things better. They didn’t just tweet, they organised. open data community was rightly sad They knew how important that data was More recent history… In 2014 the provided some money to the ODI to . The ODI pulled together . Cabinet Office’s release of data fund explore whether it was possible to rebuild the UK’s address list and publish it as open data lots of people who work with addresses to share and debate ideas The homepage of Open Addresses This led to the of . I was one of the team working for Open Addresses. We worked as openly as possible with regular and . launch Open Addresses UK blogs open source code We explored the benefits of better address data for the UK. We found that we could help fix problems such as the . Months during which someone might not be able to order a pizza, get home insurance or register to vote. We looked at the economic evidence from case studies of other countries, such as Denmark, that have released address data as open data. If . Value that we don’t get at the moment because . months it can take before new addresses are added to computer systems across the country the success of Denmark scaled in proportion to the population of the country then the UK could expect to see an extra £110 million a year of social and economic value paid data creates less economic value than open data We looked at funding models. We started off with . We got some (thank you). We knew that we would need to be able to show people what our services would look like before we could start bringing in funding from the users of address services. £383k of funding from the Cabinet Office extra funding from BCS From talking with potential users of those services we learnt about the challenges of address entry on many websites. that moving to free-format address entry would both make life easier for many people and lead to better quality address data going into organisations. We built a . User research supported our theory working demo of that service We knew we needed to gather address data. Following on from the discovery phase we built to contribute their own address data; that would allow anyone to add large sets of open data containing addresses if they followed guidelines and confirmed that they were legally allowed to publish that address data as open data; and put in place a takedown policy to investigate and remove any infringing data. For the legally minded, . This was important. In the past and the hosting model provided a defence. a model that would allow any organisation or individual we were set up to host the data people had been threatened with legal action by the Royal Mail over address data Unfortunately we hit a snag. Digital cholera makes me sad. We learned that one of the largest open data sets held by government was tainted by what we called ‘digital cholera’. It . This was no good. We wanted to . contained third party rights that government was not authorised to licence as open data publish address data that was safe to use We didn’t want to spend the limited grant funding on more and more legal advice or court battles (sorry lawyers…). So we concentrated on other approaches. We used clean open data sets and statistical techniques to we already had. For example, “if house number 1 exists and house number 5 exists then house number 3 probably exists”. multiply the address data We started developing . People could use our address services to both improve their own services and improve the address data that everyone was using. The model would enable us to learn and publish new address information (such as and new addresses) as people started to use them. This would increase the speed of publishing new information and improve data quality. By crowdsourcing data through APIs the data would get better as more people used it. a collaborative maintenance model alternative addresses — like Rose Cottage rather than 8 Acacia Avenue The team recognised that these new ways of collecting address data would impact on confidence. So, we started developing . The model allowed for different levels of trust based on how frequently we’d seen an address, who reported it, and how long ago they’d reported it. Data users could use the for their particular use case. a model that would allow the platform to declare a level of confidence in each address APIs to determine confidence and choose whether to trust an address But all this time the clock was ticking. There was limited funding. From the beginning we knew that we were testing two hypotheses. Two hypotheses. Both are true. Unfortunately we discovered that both hypotheses were true. We could build much better address services using modern approaches, but the intellectual property issues would keep hindering us. A report was published: to . As you’ll see in the report even with all of our mitigations against intellectual property violations in place, Open Addresses was only able to find one insurer who would provide it with cover for defence against Intellectual Property infringement claims. The insurers were too concerned that the Royal Mail would take legal action to protect their revenues from address data. share the lessons of what worked, and what didn’t A blog was published about . And then Open Addresses . the shades of grey in open data went to sleep Someone else would have to take up the challenge of opening up address data and making things better for everyone. Meanwhile… While Open Addresses was happening so were other things. Lots of things. I’m obviously interested in the data ones. The ODI was thinking about . Data is infrastructure to a modern society. Just like roads. Roads help us navigate to a location. Data helps us make a decision. who owned our data infrastructure Spot the infrastructure in this excellent picture by Paul Downey. The government was also working on its policy of government-as-a-platform. . The Land Registry described itself as that we could all build on. Companies House were opening up their data and putting it on the web a steel thread Things started to come together with the description of . We could all build things on top of government’s open registers. registers as authoritative list that we could all trust Registers are data infrastructure. An important part of data infrastructure is geospatial data, like addresses. Now In the 2016 budget it was announced that . government had allocated £5m to explore options to open up address data It is important to understand that this is about As Open Addresses had learnt UK addresses are pretty complex. We have to deal with. exploring options. centuries of legacy Matt Hancock, who was the Minister for the Cabinet Office when the announcement was made, likened it to the ‘ ’. US administration (decision) to allow GPS data to be made freely available for civilian use in the 1980s, which he said had “kick-started a multi-billion dollar proliferation of digital goods and services” He got the importance of this data being open. Not that surprising when you know that his parents ran a company that built “ ”. software that allows you to type your postcode into the internet and bring up your address Government is building . a common language about addresses Government is exploring the options as openly as possible. They are sharing their research into topics such as the need and complexity of . and the need for . They are trialling technology approaches, . And this all forms part of the bigger picture of building as infrastructure for the government-as-a-platform strategy. In fact just this week government announced . address matching a common language for addresses you can see the source code for yourself: it’s open registers an early version of an authoritative register for English local authorities Whilst not all of the work is in the open (remember, the arrangements for UK address data are complex commercially and legally) it is clear that many government organisations — such as the Cabinet Office, Ordnance Survey, BEIS and Treasury — are working together to explore the options and business case for an open register. Good ☺ Will the address wars ever end? All of the above is what I said in the talk at the . At the end the audience debated some of the issues raised. The legal issues seemed to confuse some people — are tricky. Eventually I was asked the most important question: will this new UK government initiative to create an open address register succeed? BCS addressing update seminar derived database rights The honest answer is “I don’t know” but I do trust the people working on it. They are good and there is clear political will to get this problem sorted. With good people and political support it’s possible to do hard things. I choose to be optimistic. I think they’ll succeed. Good ☺ The web of data is coming. It is important for the UK that they do. We need to build for the future . web of data Other countries recognise the value of . The , and have all recently made strong moves to get their address data open. data infrastructure that is as open as possible USA Australia France Data infrastructure is . We need to move on from old licensing and funding models that don’t make the best use of the qualities of the web and data. a competitive advantage in the 21st century Let’s . build better data infrastructure that makes things better for everyone
