|By Robert Eve||
|April 11, 2013 11:00 AM EDT||
While Software-as-a-Service (SaaS), Platform-as-a-Service (PaaS), and Infrastructure-as-a-Service (IaaS) offer applications and resources at an attractive, pay-as-you-go price, they also create silos of data that are difficult to access by your analytics and BI solutions.
Likewise, Big Data offers new storage techniques, processing capabilities and analytic opportunities. But traditional analytics and BI solutions are typically built assuming relational, SQL-based sources. These often struggle when trying to deliver value from these new No-SQL sources.
Cloud and Big Data Silos Add Value to Analytics and BI
Analytics and BI opportunities today are abundant and can significantly add value to a business. According to the Professors Andrew McAfee and Erik Brynjolfsson of MIT:
"Companies that inject big data and analytics into their operations show productivity rates and profitability that are 5% to 6% higher than those of their peers."
Data is the critical success factor. Because without data, there can be no analysis. The more data the better, including data sourced from the cloud, Big Data and existing enterprise data warehouses.
The Data Integration Bottleneck
Providing analytics and BI solutions with the data these require has always been difficult, with data integration long considered the biggest bottleneck in any analytics or BI project.
For the past two decades, the solution has been to consolidate the data into a data warehouse, and provide users with tools to analyze and report on this consolidated data. However, data integration based on these traditional replication and consolidation approaches have numerous moving parts that must be synchronized. Doing these properly slows solution delivery.
The Data Warehousing Institute confirms this lack of agility. Their recent study stated the average time needed to add a new data source to an existing BI application was 8.4 weeks in 2009, 7.4 weeks in 2010, and 7.8 weeks in 2011. And 33% of the organizations needed more than 3 months to add a new data source.
Cloud Data Integration is Especially Challenging
Besides being slow to develop, traditional consolidation ETL approaches don't work well with cloud data because you don't want to physically move large datasets over the internet. Further, the cloud requires specialized integration techniques, beyond many ETL products today.
For example, when you integrate data from a SaaS provider such as Salesforce.com with an on-premise customer data warehouse, you will need:
- deep knowledge of Salesforce's APIs
- a common semantic definition that rationalizes terms and structures
- the ability to query data through a firewall across the Web
- on-demand, rather than batch mode, integration operations.
How to Simplify Cloud and Big Data Integration
To provide the data that analytics and BI applications require, data virtualization products such as the Composite Data Virtualization Platform allow enterprises to flexibly integrate cloud, Big Data and enterprise data warehouses.
Key cloud and Big Data integration capabilities include:
- Rapid, Standard-based Development - Data virtualization supports a wide range of cloud based and Big Data sources via industry-standard APIs that simplify and speed new development.
- Internet-friendly Data Services - Data integration services authored and run by data virtualization platforms are perfectly suited to operate across the Internet.
- Lowest Cost Approach - Because data virtualization accesses, federates, abstracts and delivers queried data on demand, no additional cloud-based or big data storage is needed.
- Safe and Secure - Further, data virtualization's support of multiple security models ensures proper authentication, authorization and encryption both on-premise and in the cloud.
- Rich Source Data Adapters - Data virtualization easily integrates with popular SaaS applications such as salesforce.com, IaaS cloud-hosted applications such as SAP and Oracle E-Business, as well as popular Big Data types such as Hadoop, often using Hive to translate HDFS files to more analytic and BI friendly SQL formats.
Data Virtualization also Brings Agility to Analytics and BI
According to Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility, data virtualization significantly accelerates data integration agility. Key to this success is data virtualization's
- more streamlined data integration approach
- more iterative development process
- more adaptable change management process
Using data virtualization as a complement to existing data integration approaches, the ten organizations profiled in the book, many who were integrating cloud and Big Data, cut analytics and BI project times in half or more.
This agility allowed the same teams to double their number of analytics and BI projects, significantly accelerating business benefits.
Make Your CIO Happy
CIOs understand the importance of analytics and BI. According to a 2012 survey of 2300 CIOs by Gartner, analytics and BI are their number one technology priority.
Analytics and BI can make bigger business impact when they can access more data. With data in the cloud and Big Data silos, accessing and integrating these new sources can be a challenge for enterprises used to a traditional enterprise data warehouse centric data integration approach.
Data virtualization enables integration of cloud, Big Data and enterprise data warehouse sources with ease and agility.
So make your CIO happy and give data virtualization a try. You'll both be glad you did.
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
Mar. 23, 2017 10:00 PM EDT Reads: 3,378
SYS-CON Events announced today that Loom Systems will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2015, Loom Systems delivers an advanced AI solution to predict and prevent problems in the digital business. Loom stands alone in the industry as an AI analysis platform requiring no prior math knowledge from operators, leveraging the existing staff to succeed in the digital era. With offices in S...
Mar. 23, 2017 08:15 PM EDT Reads: 639
With billions of sensors deployed worldwide, the amount of machine-generated data will soon exceed what our networks can handle. But consumers and businesses will expect seamless experiences and real-time responsiveness. What does this mean for IoT devices and the infrastructure that supports them? More of the data will need to be handled at - or closer to - the devices themselves.
Mar. 23, 2017 07:15 PM EDT Reads: 4,268
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
Mar. 23, 2017 06:00 PM EDT Reads: 1,287
My team embarked on building a data lake for our sales and marketing data to better understand customer journeys. This required building a hybrid data pipeline to connect our cloud CRM with the new Hadoop Data Lake. One challenge is that IT was not in a position to provide support until we proved value and marketing did not have the experience, so we embarked on the journey ourselves within the product marketing team for our line of business within Progress. In his session at @BigDataExpo, Sum...
Mar. 23, 2017 04:15 PM EDT Reads: 2,442
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, will posit that disruption is inevitable for c...
Mar. 23, 2017 03:45 PM EDT Reads: 1,757
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Mar. 23, 2017 03:30 PM EDT Reads: 1,700
SYS-CON Events announced today that Ocean9will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Ocean9 provides cloud services for Backup, Disaster Recovery (DRaaS) and instant Innovation, and redefines enterprise infrastructure with its cloud native subscription offerings for mission critical SAP workloads.
Mar. 23, 2017 03:30 PM EDT Reads: 1,589
Providing the needed data for application development and testing is a huge headache for most organizations. The problems are often the same across companies - speed, quality, cost, and control. Provisioning data can take days or weeks, every time a refresh is required. Using dummy data leads to quality problems. Creating physical copies of large data sets and sending them to distributed teams of developers eats up expensive storage and bandwidth resources. And, all of these copies proliferating...
Mar. 23, 2017 03:00 PM EDT Reads: 6,196
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
Mar. 23, 2017 02:30 PM EDT Reads: 2,371
In recent years, containers have taken the world by storm. Companies of all sizes and industries have realized the massive benefits of containers, such as unprecedented mobility, higher hardware utilization, and increased flexibility and agility; however, many containers today are non-persistent. Containers without persistence miss out on many benefits, and in many cases simply pass the responsibility of persistence onto other infrastructure, adding additional complexity.
Mar. 23, 2017 02:30 PM EDT Reads: 4,081
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloudistics delivers a complete public cloud experience with composable on-premises infrastructures to medium and large enterprises. Its software-defined technology natively converges network, storage, compute, virtualization, and management into a ...
Mar. 23, 2017 02:30 PM EDT Reads: 1,445
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
Mar. 23, 2017 02:15 PM EDT Reads: 1,186
Pentaho has announced orchestration capabilities that streamline the entire machine learning workflow and enable teams of data scientists, engineers and analysts to train, tune, test and deploy predictive models. Pentaho’s Data Integration and analytics platform ends the ‘gridlock’ associated with machine learning by enabling smooth team collaboration, maximizing limited data science resources and putting predictive models to work on big data faster – regardless of use case, industry, or languag...
Mar. 23, 2017 01:00 PM EDT Reads: 2,120
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
Mar. 23, 2017 12:45 PM EDT Reads: 1,685