|By Paul Miller||
|October 1, 2012 04:32 AM EDT||
O’Reilly’s Big Data extravaganza, Strata, left its native U.S. for the first time this week, coming to London for two days of data; the big, the open, the structured, the unstructured, and the undecided.
Whilst many of the companies and issues are the same, whether you’re in London, California or New York City, there are also plenty of ways in which local philosophy, approach, and mindset impact upon what’s possible – and what’s important. O’Reilly delivered this message loud and clear this morning, devoting the first two sessions of the opening morning to stories from the UK’s open data-enthusiastic government.
Rather raw notes follow…
First up, Liam Maxwell (@liammax) from the Cabinet Office. What is the government doing about data, open data, and the role of IT in all of that? We spend 1% of GDP on government IT systems. But we want to deliver efficiencies, and enable the UK economy to grow. Transparency is important; for example, local government must publish any expenditure over £500… originally, it was meant to be £5,000. £500 is better!
Open Government Partnership – open government makes sense. It’s become an orthodoxy.
Also keen on open source. But not because open source is necessarily best. Rather, that approach is fundamental to opening up markets. Coalition Agreement (between Conservative and LibDem sides of the UK government) makes an explicit mention of importance of open source. The only statement of government that does?
Open Standards also important. Done it wrong in the past. Hopefully announcing new – sensible – policy by the end of October.
Most of our IT in the past has been developed on closed systems in a black box. Even the customer hasn’t had the right to look inside. Want to use open data to open up markets. New procurement frameworks and strategies saving 30% or more of spend. Open market to ensure that the best possible people can bid for a project. If the project is too big (like in the old days) then only the largest incumbents can compete.
He mentions last week’s EU cloud strategy [I'm writing a report on that, which will be out in a couple of weeks...] – concerned about the provision to certify cloud providers, as it will reinforce the current dominant players. Microsoft, Amazon et al big and strong enough to waste time getting certified. But what about the nimble startups? Will they even bother? [Interesting perspective...]
“We leave money on the table when we don’t deal with SMEs.” And those SMEs grow to become medium businesses, and then global success stories.
The Government Digital Service (@gdsteam) “is the future of Government.”
The future is going to be digital. We’re falling out of love with our big tin, and moving towards a future that is nimbler and more citizen-focussed. We understand open data, and we understand the use of this stuff to deliver better services.
Next up, Jeni Tennison (@jenit), who has just joined the new Open Data Institute.
Today is her first day… Open Data – dreams to reality.
How do we take freely available data and actually derive real benefit from it.
Open Data + magic = economic growth. Indeed.
Open Data + magic = democratic engagement (“we’ll take open data and it will make people like politicians.”)
Open Data + magic = supreme awesomeness.
But how do we actually make this happen?
Open Data is a tool.
The open data projects that are most exciting to her are the ones with specific goals – to get people riding bikes, to let them see legislation, etc.
Open Data can be used for ill as well as for good. It is just a tool. We need to learn how to wield it responsibly.
It’s a versatile tool (big swiss army knife on screen…).
The web is great now… but we couldn’t have anticipated all its uses ten years ago. Possibilities. Opportunities. We need to experiment, because we don’t actually know where it will lead.
Open Data Institute is where we’re going to think about this stuff in the UK. Set up by Tim Berners-Lee and Nigel Shadbolt.
Our main aim is to collaborate with businesses, government, the wider public sector and academia to realise the benefits of open data – economic, social, environmental.
We’ll address two different sets of people; data owners and data re-users.
We need to think about how data owners publish their data. How do they develop processes that make sense, that manage the data, that are sustainable, that enable data to flow? The data release needs to fit their business model, and it needs to be sustainable and a reliable foundation for other businesses. Otherwise, it’s just people flinging spreadhseets out there, and that won’t work forever.
For data reusers, we need to think about how the data appears. How it is visualised, but also how it is analysed, described, etc. Conclusions must be statistically significant and replicable. We need to protect too – privacy, data protection, etc. We need to build understanding and capability.
Knowing Jeni, she’ll have that lot sorted by the end of day two…
The event is also live-streaming, at strataconf.com/live – do drop in over the next day and a half.
In their Live Hack” presentation at 17th Cloud Expo, Stephen Coty and Paul Fletcher, Chief Security Evangelists at Alert Logic, provided the audience with a chance to see a live demonstration of the common tools cyber attackers use to attack cloud and traditional IT systems. This “Live Hack” used open source attack tools that are free and available for download by anybody. Attendees learned where to find and how to operate these tools for the purpose of testing their own IT infrastructure. The...
Mar. 28, 2017 04:45 AM EDT Reads: 7,463
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor - all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
Mar. 28, 2017 02:30 AM EDT Reads: 2,010
My team embarked on building a data lake for our sales and marketing data to better understand customer journeys. This required building a hybrid data pipeline to connect our cloud CRM with the new Hadoop Data Lake. One challenge is that IT was not in a position to provide support until we proved value and marketing did not have the experience, so we embarked on the journey ourselves within the product marketing team for our line of business within Progress. In his session at @BigDataExpo, Sum...
Mar. 28, 2017 02:15 AM EDT Reads: 3,086
The modern software development landscape consists of best practices and tools that allow teams to deliver software in a near-continuous manner. By adopting a culture of automation, measurement and sharing, the time to ship code has been greatly reduced, allowing for shorter release cycles and quicker feedback from customers and users. Still, with all of these tools and methods, how can teams stay on top of what is taking place across their infrastructure and codebase? Hopping between services a...
Mar. 28, 2017 02:15 AM EDT Reads: 9,901
Virtualization over the past years has become a key strategy for IT to acquire multi-tenancy, increase utilization, develop elasticity and improve security. And virtual machines (VMs) are quickly becoming a main vehicle for developing and deploying applications. The introduction of containers seems to be bringing another and perhaps overlapped solution for achieving the same above-mentioned benefits. Are a container and a virtual machine fundamentally the same or different? And how? Is one techn...
Mar. 28, 2017 02:15 AM EDT Reads: 3,097
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex softw...
Mar. 28, 2017 02:00 AM EDT Reads: 3,888
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
Mar. 28, 2017 01:00 AM EDT Reads: 2,337
What sort of WebRTC based applications can we expect to see over the next year and beyond? One way to predict development trends is to see what sorts of applications startups are building. In his session at @ThingsExpo, Arin Sime, founder of WebRTC.ventures, will discuss the current and likely future trends in WebRTC application development based on real requests for custom applications from real customers, as well as other public sources of information,
Mar. 28, 2017 12:45 AM EDT Reads: 975
Interoute has announced the integration of its Global Cloud Infrastructure platform with Rancher Labs’ container management platform, Rancher. This approach enables enterprises to accelerate their digital transformation and infrastructure investments. Matthew Finnie, Interoute CTO commented “Enterprises developing and building apps in the cloud and those on a path to Digital Transformation need Digital ICT Infrastructure that allows them to build, test and deploy faster than ever before. The int...
Mar. 28, 2017 12:00 AM EDT Reads: 1,244
Whether you like it or not, DevOps is on track for a remarkable alliance with security. The SEC didn’t approve the merger. And your boss hasn’t heard anything about it. Yet, this unruly triumvirate will soon dominate and deliver DevSecOps faster, cheaper, better, and on an unprecedented scale. In his session at DevOps Summit, Frank Bunger, VP of Customer Success at ScriptRock, discussed how this cathartic moment will propel the DevOps movement from such stuff as dreams are made on to a practic...
Mar. 28, 2017 12:00 AM EDT Reads: 8,375
ChatOps is an emerging topic that has led to the wide availability of integrations between group chat and various other tools/platforms. Currently, HipChat is an extremely powerful collaboration platform due to the various ChatOps integrations that are available. However, DevOps automation can involve orchestration and complex workflows. In his session at @DevOpsSummit at 20th Cloud Expo, Himanshu Chhetri, CTO at Addteq, will cover practical examples and use cases such as self-provisioning infra...
Mar. 27, 2017 11:30 PM EDT Reads: 3,061
The cloud competition for database hosts is fierce. How do you evaluate a cloud provider for your database platform? In his session at 18th Cloud Expo, Chris Presley, a Solutions Architect at Pythian, gave users a checklist of considerations when choosing a provider. Chris Presley is a Solutions Architect at Pythian. He loves order – making him a premier Microsoft SQL Server expert. Not only has he programmed and administered SQL Server, but he has also shared his expertise and passion with budd...
Mar. 27, 2017 09:45 PM EDT Reads: 3,055
"My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Mar. 27, 2017 09:45 PM EDT Reads: 3,658
Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing and analyzing streaming data is the Lambda Architecture, represent...
Mar. 27, 2017 08:15 PM EDT Reads: 6,329
SYS-CON Events announced today that Ocean9will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Ocean9 provides cloud services for Backup, Disaster Recovery (DRaaS) and instant Innovation, and redefines enterprise infrastructure with its cloud native subscription offerings for mission critical SAP workloads.
Mar. 27, 2017 07:45 PM EDT Reads: 2,209