Welcome!

Blog Feed Post

O’Reilly’s Strata comes to Europe, with a very British opening

O’Reilly’s Big Data extravaganza, Strata, left its native U.S. for the first time this week, coming to London for two days of data; the big, the open, the structured, the unstructured, and the undecided.

Whilst many of the companies and issues are the same, whether you’re in London, California or New York City, there are also plenty of ways in which local philosophy, approach, and mindset impact upon what’s possible – and what’s important. O’Reilly delivered this message loud and clear this morning, devoting the first two sessions of the opening morning to stories from the UK’s open data-enthusiastic government.

Rather raw notes follow…

First up, Liam Maxwell (@liammax) from the Cabinet Office. What is the government doing about data, open data, and the role of IT in all of that? We spend 1% of GDP on government IT systems. But we want to deliver efficiencies, and enable the UK economy to grow. Transparency is important; for example, local government must publish any expenditure over £500… originally, it was meant to be £5,000. £500 is better!

Open Government Partnership – open government makes sense. It’s become an orthodoxy.

Also keen on open source. But not because open source is necessarily best. Rather, that approach is fundamental to opening up markets. Coalition Agreement (between Conservative and LibDem sides of the UK government) makes an explicit mention of importance of open source. The only statement of government that does?

Open Standards also important. Done it wrong in the past. Hopefully announcing new – sensible – policy by the end of October.

Most of our IT in the past has been developed on closed systems in a black box. Even the customer hasn’t had the right to look inside. Want to use open data to open up markets. New procurement frameworks and strategies saving 30% or more of spend. Open market to ensure that the best possible people can bid for a project. If the project is too big (like in the old days) then only the largest incumbents can compete.

He mentions last week’s EU cloud strategy [I'm writing a report on that, which will be out in a couple of weeks...] – concerned about the provision to certify cloud providers, as it will reinforce the current dominant players. Microsoft, Amazon et al big and strong enough to waste time getting certified. But what about the nimble startups? Will they even bother? [Interesting perspective...]

“We leave money on the table when we don’t deal with SMEs.” And those SMEs grow to become medium businesses, and then global success stories.

The Government Digital Service (@gdsteam) “is the future of Government.”

The future is going to be digital. We’re falling out of love with our big tin, and moving towards a future that is nimbler and more citizen-focussed. We understand open data, and we understand the use of this stuff to deliver better services.

Next up, Jeni Tennison (@jenit), who has just joined the new Open Data Institute.

Today is her first day… Open Data – dreams to reality.

How do we take freely available data and actually derive real benefit from it.

Open Data + magic = economic growth. Indeed.

Open Data + magic = democratic engagement (“we’ll take open data and it will make people like politicians.”)

Open Data + magic = supreme awesomeness.

But how do we actually make this happen?

Open Data is a tool.

The open data projects that are most exciting to her are the ones with specific goals – to get people riding bikes, to let them see legislation, etc.

Open Data can be used for ill as well as for good. It is just a tool. We need to learn how to wield it responsibly.

It’s a versatile tool (big swiss army knife on screen…).

The web is great now… but we couldn’t have anticipated all its uses ten years ago. Possibilities. Opportunities. We need to experiment, because we don’t actually know where it will lead.

Open Data Institute is where we’re going to think about this stuff in the UK. Set up by Tim Berners-Lee and Nigel Shadbolt.

Our main aim is to collaborate with businesses, government, the wider public sector and academia to realise the benefits of open data – economic, social, environmental.

We’ll address two different sets of people; data owners and  data re-users.

We need to think about how data owners publish their data. How do they develop processes that make sense, that manage the data, that are sustainable, that enable data to flow? The data release needs to fit their business model, and it needs to be sustainable and a reliable foundation for other businesses. Otherwise, it’s just people flinging spreadhseets out there, and that won’t work forever.

For data reusers, we need to think about how the data appears. How it is visualised, but also how it is analysed, described, etc. Conclusions must be statistically significant and replicable. We need to protect too – privacy, data protection, etc. We need to build understanding and capability.

Knowing Jeni, she’ll have that lot sorted by the end of day two… :-)

The event is also live-streaming, at strataconf.com/live – do drop in over the next day and a half.

Image by Flickr user Tim Morris

Read the original blog entry...

More Stories By Paul Miller

Paul Miller works at the interface between the worlds of Cloud Computing and the Semantic Web, providing the insights that enable you to exploit the next wave as we approach the World Wide Database.

He blogs at www.cloudofdata.com.

Latest Stories
Whether they’re located in a public, private, or hybrid cloud environment, cloud technologies are constantly evolving. While the innovation is exciting, the end mission of delivering business value and rapidly producing incremental product features is paramount. In his session at @DevOpsSummit at 19th Cloud Expo, Kiran Chitturi, CTO Architect at Sungard AS, will discuss DevOps culture, its evolution of frameworks and technologies, and how it is achieving maturity. He will also cover various st...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
There are several IoTs: the Industrial Internet, Consumer Wearables, Wearables and Healthcare, Supply Chains, and the movement toward Smart Grids, Cities, Regions, and Nations. There are competing communications standards every step of the way, a bewildering array of sensors and devices, and an entire world of competing data analytics platforms. To some this appears to be chaos. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, Bradley Holt, Developer Advocate a...
SYS-CON Events announced today that Niagara Networks will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Niagara Networks offers the highest port-density systems, and the most complete Next-Generation Network Visibility systems including Network Packet Brokers, Bypass Switches, and Network TAPs.
SYS-CON Events announced today that Secure Channels will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. The bedrock of Secure Channels Technology is a uniquely modified and enhanced process based on superencipherment. Superencipherment is the process of encrypting an already encrypted message one or more times, either using the same or a different algorithm.
If you’re responsible for an application that depends on the data or functionality of various IoT endpoints – either sensors or devices – your brand reputation depends on the security, reliability, and compliance of its many integrated parts. If your application fails to deliver the expected business results, your customers and partners won't care if that failure stems from the code you developed or from a component that you integrated. What can you do to ensure that the endpoints work as expect...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, provided tips on how to be successful in large scale machine learning...
If you had a chance to enter on the ground level of the largest e-commerce market in the world – would you? China is the world’s most populated country with the second largest economy and the world’s fastest growing market. It is estimated that by 2018 the Chinese market will be reaching over $30 billion in gaming revenue alone. Admittedly for a foreign company, doing business in China can be challenging. Often changing laws, administrative regulations and the often inscrutable Chinese Interne...
In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
Complete Internet of Things (IoT) embedded device security is not just about the device but involves the entire product’s identity, data and control integrity, and services traversing the cloud. A device can no longer be looked at as an island; it is a part of a system. In fact, given the cross-domain interactions enabled by IoT it could be a part of many systems. Also, depending on where the device is deployed, for example, in the office building versus a factory floor or oil field, security ha...
More and more companies are looking to microservices as an architectural pattern for breaking apart applications into more manageable pieces so that agile teams can deliver new features quicker and more effectively. What this pattern has done more than anything to date is spark organizational transformations, setting the foundation for future application development. In practice, however, there are a number of considerations to make that go beyond simply “build, ship, and run,” which changes ho...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
SYS-CON Events announced today that eCube Systems, a leading provider of middleware modernization, integration, and management solutions, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. eCube Systems offers a family of middleware evolution products and services that maximize return on technology investment by leveraging existing technical equity to meet evolving business needs. ...
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addres...