Welcome!

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, @BigDataExpo, SDN Journal

@CloudExpo: Article

Unify Cloud, Big Data and Enterprise Data with Ease

Make Better Business Decisions using More Data

While Software-as-a-Service (SaaS), Platform-as-a-Service (PaaS), and Infrastructure-as-a-Service (IaaS) offer applications and resources at an attractive, pay-as-you-go price, they also create silos of data that are difficult to access by your analytics and BI solutions.

Likewise, Big Data offers new storage techniques, processing capabilities and analytic opportunities.  But traditional analytics and BI solutions are typically built assuming relational, SQL-based sources. These often struggle when trying to deliver value from these new No-SQL sources.

Cloud and Big Data Silos Add Value to Analytics and BI
Analytics and BI opportunities today are abundant and can significantly add value to a business. According to the Professors Andrew McAfee and Erik Brynjolfsson of MIT:

"Companies that inject big data and analytics into their operations show productivity rates and profitability that are 5% to 6% higher than those of their peers."

Data is the critical success factor.  Because without data, there can be no analysis. The more data the better, including data sourced from the cloud, Big Data and existing enterprise data warehouses.

The Data Integration Bottleneck
Providing analytics and BI solutions with the data these require has always been difficult, with data integration long considered the biggest bottleneck in any analytics or BI project.

For the past two decades, the solution has been to consolidate the data into a data warehouse, and provide users with tools to analyze and report on this consolidated data.  However, data integration based on these traditional replication and consolidation approaches have numerous moving parts that must be synchronized.  Doing these properly slows solution delivery.

The Data Warehousing Institute confirms this lack of agility. Their recent study stated the average time needed to add a new data source to an existing BI application was 8.4 weeks in 2009, 7.4 weeks in 2010, and 7.8 weeks in 2011. And 33% of the organizations needed more than 3 months to add a new data source.

Cloud Data Integration is Especially Challenging
Besides being slow to develop, traditional consolidation ETL approaches don't work well with cloud data because you don't want to physically move large datasets over the internet.  Further, the cloud requires specialized integration techniques, beyond many ETL products today.

For example, when you integrate data from a SaaS provider such as Salesforce.com with an on-premise customer data warehouse, you will need:

  • deep knowledge of Salesforce's APIs
  • a common semantic definition that rationalizes terms and  structures
  • the ability to query data through a firewall across the Web
  • on-demand, rather than batch mode, integration operations.

How to Simplify Cloud and Big Data Integration
To provide the data that analytics and BI applications require, data virtualization products such as the Composite Data Virtualization Platform allow enterprises to flexibly integrate cloud, Big Data and enterprise data warehouses.

Key cloud and Big Data integration capabilities include:

  • Rapid, Standard-based Development - Data virtualization supports a wide range of cloud based and Big Data sources via industry-standard APIs that simplify and speed new development.
  • Internet-friendly Data Services - Data integration services authored and run by data virtualization platforms are perfectly suited to operate across the Internet.
  • Lowest Cost Approach - Because data virtualization accesses, federates, abstracts and delivers queried data on demand, no additional cloud-based or big data storage is needed.
  • Safe and Secure - Further, data virtualization's support of multiple security models ensures proper authentication, authorization and encryption both on-premise and in the cloud.
  • Rich Source Data Adapters - Data virtualization easily integrates with popular SaaS applications such as salesforce.com, IaaS cloud-hosted applications such as SAP and Oracle E-Business, as well as popular Big Data types such as Hadoop, often using Hive to translate HDFS files to more analytic and BI friendly SQL formats.

Data Virtualization also Brings Agility to Analytics and BI
According to Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility, data virtualization significantly accelerates data integration agility. Key to this success is data virtualization's

  • more streamlined data integration approach
  • more iterative development process
  • more adaptable change management process

Using data virtualization as a complement to existing data integration approaches, the ten organizations profiled in the book, many who were integrating cloud and Big Data, cut analytics and BI project times in half or more.

This agility allowed the same teams to double their number of analytics and BI projects, significantly accelerating business benefits.

Make Your CIO Happy
CIOs understand the importance of analytics and BI. According to a 2012 survey of 2300 CIOs by Gartner, analytics and BI are their number one technology priority.

Analytics and BI can make bigger business impact when they can access more data. With data in the cloud and Big Data silos, accessing and integrating these new sources can be a challenge for enterprises used to a traditional enterprise data warehouse centric data integration approach.

Data virtualization enables integration of cloud, Big Data and enterprise data warehouse sources with ease and agility.

So make your CIO happy and give data virtualization a try. You'll both be glad you did.

More Stories By Robert Eve

Robert Eve is the EVP of Marketing at Composite Software, the data virtualization gold standard and co-author of Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility. Bob's experience includes executive level roles at leading enterprise software companies such as Mercury Interactive, PeopleSoft, and Oracle. Bob holds a Masters of Science from the Massachusetts Institute of Technology and a Bachelor of Science from the University of California at Berkeley.

Latest Stories
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
"We are a monitoring company. We work with Salesforce, BBC, and quite a few other big logos. We basically provide monitoring for them, structure for their cloud services and we fit into the DevOps world" explained David Gildeh, Co-founder and CEO of Outlyer, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 21st Int\ernational Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to focus on the core of their ...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might...
Automation is enabling enterprises to design, deploy, and manage more complex, hybrid cloud environments. Yet the people who manage these environments must be trained in and understanding these environments better than ever before. A new era of analytics and cognitive computing is adding intelligence, but also more complexity, to these cloud environments. How smart is your cloud? How smart should it be? In this power panel at 20th Cloud Expo, moderated by Conference Chair Roger Strukhoff, pane...
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo Silicon Valley which will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is at the intersection of technology and business-optimizing tools, organizations and processes to bring measurable improvements in productivity and profitability," said Aruna Ravichandran, vice president, DevOps product and solutions marketing...
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
In his session at Cloud Expo, Alan Winters, an entertainment executive/TV producer turned serial entrepreneur, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to ma...
In the world of DevOps there are ‘known good practices’ – aka ‘patterns’ – and ‘known bad practices’ – aka ‘anti-patterns.' Many of these patterns and anti-patterns have been developed from real world experience, especially by the early adopters of DevOps theory; but many are more feasible in theory than in practice, especially for more recent entrants to the DevOps scene. In this power panel at @DevOpsSummit at 18th Cloud Expo, moderated by DevOps Conference Chair Andi Mann, panelists discussed...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.