News Feed Item
Databricks Launches “Certified Spark Distribution” Program to Recognize Vendors Committed to Supporting the Apache Spark Application Ecosystem
|By Business Wire
|June 26, 2014 12:11 PM EDT
Databricks, the company founded by the creators of Apache Spark, the
next generation Big Data engine, today announced the “Certified Spark
Distribution” program for vendors with a commercial Spark distribution.
Certification indicates that the vendor’s Spark distribution is
compatible with the open source Apache Spark distribution, enabling
“Certified on Spark” applications - certified to work with Apache Spark
- to run on the vendor’s Spark distribution out-of-the-box.
“One of Databricks’ goals is to ensure users have a fantastic
experience. Our belief is that having the community work together to
maintain compatibility and therefore facilitate a vibrant application
ecosystem is crucial to this vision,” said Ion Stoica, Databricks CEO.
“We first launched the ‘Certified on Spark’ program to help build a
robust ecosystem of innovative applications on top of Apache Spark. The
‘Certified Spark Distribution’ program is the other half of the
equation, recognizing vendors that are committed to providing a home for
these applications to allow the ecosystem to flourish.”
In keeping with the open source nature of Spark, the certification
process is fully transparent with open-source tests, lightweight, and
100% free - a mirror image of the “Certified on Spark” process for Spark
applications. Vendors fill out a short questionnaire and then simply
execute a set of open-source tests - developed and maintained by the
community and used to test each release of Apache Spark - against their
build of Spark to demonstrate compatibility.
“Certification shouldn’t be used as a tool for lock-in: Certified Spark
Distributions are not required to ship all the bits of Apache Spark, or
be open source, or prevented from innovating significantly within and
around Spark,” said Arsalan Tavakoli-Shiraji, Business Development Lead
at Databricks. “They simply need to maintain compatibility with Apache
Spark to provide support for the application ecosystem.”
As part of the certification program launch, five vendors have completed
the certification process: DataStax,
Oracle, and Pivotal
- industry leaders that have recognized and embraced the power of Spark
when integrated with their respective platforms. Each of these vendors
put their distributions through the certification process, which
included a host of integration tests to ensure full compatibility with
the latest Apache Spark release.
“One of the big risks faced by open source projects is fragmentation
among distributors. Fragmentation is bad for both users and application
developers, and ultimately for the growth of the project,” said Matei
Zaharia, Databricks CTO and VP of the Spark project at Apache. “We are
delighted that these partners - along with others in the certification
pipeline - share our vision of an undivided Spark platform based
directly around Apache, and will ensure that all applications built on
Apache Spark run on their distributions.”
Vendors interested in certifying their Spark distribution should visit www.databricks.com
and select "Apply for Certification." Enterprise users can also visit
the Databricks site regularly to see the latest set of certified
distributions and applications, and read “spotlight” blog articles that
provide deep-dives on the Spark ecosystem by newly certified vendors.
All the inaugural members will be on hand at the upcoming Spark
Summit from June 30th to July 2nd in San Francisco to provide
greater information on the role of Spark in helping better serve their
customers. Additionally, there will be an “Application
Spotlight” segment that will highlight innovative “Certified on
"DataStax is strongly committed to making Cassandra and Spark the best
combination for today's online applications," said Robin Schumacher, VP
of products at DataStax. "We have demonstrated that commitment with the
integration work we have contributed back to both open source
communities as well as the certified versions of Spark and Cassandra we
provide in DataStax Enterprise for production environments."
“We support the fact that Apache Spark project provides enterprises with
an additional processing engine in Hadoop to execute in-memory
algorithms for advanced analytics,” said John Kreisa, vice president of
strategic marketing at Hortonworks. “We applaud Databricks’ vision to
ensure Spark is fully integrated on YARN, which enterprises have adopted
as the data OS for Hadoop.”
"Pivotal's open source credentials are quite extensive -
Apache-compatible Hadoop, MADLib, RabbitMQ, CloudFoundry - and now we've
added Spark to that set," said Sarabjeet Chugh, Head of Hadoop Product
Management at Pivotal. "Additionally, we recognize the importance of a
unified community to enable the ecosystem to grow and so are thrilled to
back this effort."
Databricks was founded by the creators of Apache Spark, who have been
working for the past six years on cutting-edge systems to analyze and
process Big Data. They believe that Big Data is a tremendous opportunity
that is still largely untapped, and are actively working to
revolutionize what enterprises can do with it. Databricks is
venture-backed by Andreessen Horowitz. For more information, visit http://www.databricks.com.
Actian Corporation has announced the latest version of the Actian Vector in Hadoop (VectorH) database, generally available at the end of July. VectorH is based on the same query engine that powers Actian Vector, which recently doubled the TPC-H benchmark record for non-clustered systems at the 3000GB scale factor (see tpc.org/3323).
The ability to easily ingest information from different data sources and rapidly develop queries to make better business decisions is becoming increasingly importan...
Aug. 26, 2016 10:45 PM EDT Reads: 2,051
SYS-CON Events announced today that 910Telecom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Housed in the classic Denver Gas & Electric Building, 910 15th St., 910Telecom is a carrier-neutral telecom hotel located in the heart of Denver. Adjacent to CenturyLink, AT&T, and Denver Main, 910Telecom offers connectivity to all major carriers, Internet service providers, Internet backbones and ...
Aug. 26, 2016 10:00 PM EDT Reads: 1,837
Kubernetes, Docker and containers are changing the world, and how companies are deploying their software and running their infrastructure. With the shift in how applications are built and deployed, new challenges must be solved.
In his session at @DevOpsSummit at19th Cloud Expo, Sebastian Scheele, co-founder of Loodse, will discuss the implications of containerized applications/infrastructures and their impact on the enterprise. In a real world example based on Kubernetes, he will show how to ...
Aug. 26, 2016 09:15 PM EDT Reads: 1,424
Traditional on-premises data centers have long been the domain of modern data platforms like Apache Hadoop, meaning companies who build their business on public cloud were challenged to run Big Data processing and analytics at scale. But recent advancements in Hadoop performance, security, and most importantly cloud-native integrations, are giving organizations the ability to truly gain value from all their data.
In his session at 19th Cloud Expo, David Tishgart, Director of Product Marketing ...
Aug. 26, 2016 07:15 PM EDT Reads: 389
SYS-CON Events announced today Telecom Reseller has been named “Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Aug. 26, 2016 07:00 PM EDT Reads: 649
As the world moves toward more DevOps and Microservices, application deployment to the cloud ought to become a lot simpler. The Microservices architecture, which is the basis of many new age distributed systems such as OpenStack, NetFlix and so on, is at the heart of Cloud Foundry - a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS. Serverless computing is revolutionizing computing.
In his session at 19th Cloud Expo, Raghav...
Aug. 26, 2016 07:00 PM EDT Reads: 690
Aspose.Total for .NET is the most complete package of all file format APIs for .NET as offered by Aspose. It empowers developers to create, edit, render, print and convert between a wide range of popular document formats within any .NET, C#, ASP.NET and VB.NET applications.
Aspose compiles all .NET APIs on a daily basis to ensure that it contains the most up to date versions of each of Aspose .NET APIs. If a new .NET API or a new version of existing APIs is released during the subscription peri...
Aug. 26, 2016 06:00 PM EDT Reads: 1,919
SYS-CON Events announced today that StarNet Communications will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
StarNet Communications’ FastX is the industry first cloud-based remote X Windows emulator. Using standard Web browsers (FireFox, Chrome, Safari, etc.) users from around the world gain highly secure access to applications and data hosted on Linux-based servers in a central data center. ...
Aug. 26, 2016 05:00 PM EDT Reads: 665
Smart Cities are here to stay, but for their promise to be delivered, the data they produce must not be put in new siloes.
In his session at @ThingsExpo, Mathias Herberts, Co-founder and CTO of Cityzen Data, will deep dive into best practices that will ensure a successful smart city journey.
Aug. 26, 2016 04:45 PM EDT Reads: 1,529
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
Aug. 26, 2016 04:30 PM EDT Reads: 2,305
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location.
With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
Aug. 26, 2016 04:00 PM EDT Reads: 3,930
StarNet Communications Corp has announced the addition of three Secure Remote Desktop modules to its flagship X-Win32 PC X server. The new modules enable X-Win32 to safely tunnel the remote desktops from Linux and Unix servers to the user’s PC over encrypted SSH.
Traditionally, users of PC X servers deploy the XDMCP protocol to display remote desktop environments such as the Gnome and KDE desktops on Linux servers and the CDE environment on Solaris Unix machines. XDMCP is used primarily on comp...
Aug. 26, 2016 03:45 PM EDT Reads: 557
There is growing need for data-driven applications and the need for digital platforms to build these apps.
In his session at 19th Cloud Expo, Muddu Sudhakar, VP and GM of Security & IoT at Splunk, will cover different PaaS solutions and Big Data platforms that are available to build applications.
In addition, AI and machine learning are creating new requirements that developers need in the building of next-gen apps. The next-generation digital platforms have some of the past platform needs a...
Aug. 26, 2016 03:15 PM EDT Reads: 426
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open.
Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
Aug. 26, 2016 01:30 PM EDT Reads: 3,417
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications.
In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability.
Aug. 26, 2016 01:00 PM EDT Reads: 1,978