Welcome!

Related Topics: Containers Expo Blog, @CloudExpo, SDN Journal

Containers Expo Blog: Article

True Scale-out Storage | @CloudExpo #IoT #ML #Storage #SDS #DataCenter

Data centers are transitioning from vertical scaling to efficient, cost-effective options that will supply the storage they need

A Pair of Virtual Technologies to Create True Scale-out Storage

Almost three years ago, VMware introduced the world to its virtual SAN. This new solution enabled customers to use storage within ESXi servers without the need for external storage - an exciting promise for organizations that wanted to quickly scale their virtual storage. Now, it's time to check in on this technology and see if it's living up to its promise.

VMware became a player in the storage array and software market when it launched vSAN. Server admins were looking forward to using vSAN because it gave them a symmetrical architecture that did not require external storage, thus being able to use storage within existing servers. It also doesn't require specialized storage skills. However, no one solution can be all things to all enterprises, and as enterprises began to deploy vSAN across their environments, they noticed something big was missing.

The Benefits of Adding vNAS
The big thing vSAN was missing was support for a file system. The importance of having a file system within a data center cannot be overstated. Without a file system, the guest VMs cannot share files between them and are forced to use an external NAS solution as shared storage. Without a file system overlaying this data, it becomes impossible to scale efficiently.

That's not the only issue. As virtual environments have taken hold in every industry, an enterprise setting requires support for hypervisors as well. Therefore, a scale-out vNAS needs to be able to run as a hyper-converged set-up. As a result, a software-defined infrastructure strategy makes sense here.

When no external storage systems are present, the vNAS must be able to run as a virtual machine and make use of the hypervisor host's physical resources. The guest virtual machine's (VM) own images and data will be stored in the virtual file system that the vNAS provides. The guest VMs can use this file system to share files between them, making it perfect for VDI environments as well.

With an architecture that allows users to start small and scale up, vNAS creates a flexible and scalable storage solution. It is software-defined, supporting both fast and energy-efficient hardware and bare-metal, as well as virtual environments.

Protocols are an important consideration as well. vSAN uses a block protocol within the cluster, but when designing storage architecture, it's important to support many protocols. Why? In a virtual environment, there are many different applications running, having different protocol needs. By supporting many protocols, the architecture is kept flat, with the ability to share data between applications that speak different protocols, to some extent.

Creating Flexibility
For enterprises that operate from multiple offices, each site has its own independent file system. It's probable that different offices have a need for both a private area and an area that they share with other branches. So only parts of the file system will be shared with others. This common scenario, so essential to the functioning of a typical business, cannot be achieved with a vSAN.

Hybrid cloud set-ups are increasingly common today as organizations find the benefit of storing data both onsite and in the cloud. Being able to use just the amount of cloud storage needed depending on the group's needs delivers excellent gains in performance and flexibility. The challenge is that in vSAN, there is no file system that can be extended to cover the data in the cloud, and files cannot be shared between the onsite location and the cloud.

But when vNAS is being used as the basis for a hybrid cloud architecture, each site has its own independent file system. In a typical organization, different offices will need both a private area and an area that they share with other branches. As a result, only parts of the file system will be shared with others.

Allocating a certain section of a file system and letting others mount it at any given point in the other file systems delivers the flexibility needed to scale the file system beyond the office walls - ensuring that the synchronization is made at the file system level in order to have a consistent view of the file system across sites. Being able to specify different file encodings at different sites is useful, for example, if one site is used as a backup target.

Coming Full Circle
Data centers are transitioning from vertical scaling, which cannot keep pace with today's data demands, to efficient and cost-effective options that will supply the storage they need. vSAN's symmetrical architecture and ease of use are one part of the storage answer; vNAS's file system support is the other. By creating a single file system spanning all servers, vNAS enables vSAN to fulfill its promise.

More Stories By Stefan Bernbo

Stefan Bernbo is the founder and CEO of Compuverde. For 20 years, he has designed and built numerous enterprise scale data storage solutions designed to be cost effective for storing huge data sets. From 2004 to 2010 Stefan worked within this field for Storegate, the wide-reaching Internet based storage solution for consumer and business markets, with the highest possible availability and scalability requirements. Previously, Stefan has worked with system and software architecture on several projects with Swedish giant Ericsson, the world-leading provider of telecommunications equipment and services to mobile and fixed network operators.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Latest Stories
What sort of WebRTC based applications can we expect to see over the next year and beyond? One way to predict development trends is to see what sorts of applications startups are building. In his session at @ThingsExpo, Arin Sime, founder of WebRTC.ventures, will discuss the current and likely future trends in WebRTC application development based on real requests for custom applications from real customers, as well as other public sources of information,
China Unicom exhibit at the 19th International Cloud Expo, which took place at the Santa Clara Convention Center in Santa Clara, CA, in November 2016. China United Network Communications Group Co. Ltd ("China Unicom") was officially established in 2009 on the basis of the merger of former China Netcom and former China Unicom. China Unicom mainly operates a full range of telecommunications services including mobile broadband (GSM, WCDMA, LTE FDD, TD-LTE), fixed-line broadband, ICT, data communica...
My team embarked on building a data lake for our sales and marketing data to better understand customer journeys. This required building a hybrid data pipeline to connect our cloud CRM with the new Hadoop Data Lake. One challenge is that IT was not in a position to provide support until we proved value and marketing did not have the experience, so we embarked on the journey ourselves within the product marketing team for our line of business within Progress. In his session at @BigDataExpo, Sum...
As software becomes more and more complex, we, as software developers, have been splitting up our code into smaller and smaller components. This is also true for the environment in which we run our code: going from bare metal, to VMs to the modern-day Cloud Native world of containers, schedulers and micro services. While we have figured out how to run containerized applications in the cloud using schedulers, we've yet to come up with a good solution to bridge the gap between getting your contain...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, will discuss some of the security challenges of the IoT infrastructure and relate how these aspects impact Smart Living. The material will be delivered i...
Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing and analyzing streaming data is the Lambda Architecture, represent...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, will provide a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services ...
SYS-CON Events announced today that Ocean9will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Ocean9 provides cloud services for Backup, Disaster Recovery (DRaaS) and instant Innovation, and redefines enterprise infrastructure with its cloud native subscription offerings for mission critical SAP workloads.
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, will posit that disruption is inevitable for c...
Building a cross-cloud operational model can be a daunting task. Per-cloud silos are not the answer, but neither is a fully generic abstraction plane that strips out capabilities unique to a particular provider. In his session at 20th Cloud Expo, Chris Wolf, VP & Chief Technology Officer, Global Field & Industry at VMware, will discuss how successful organizations approach cloud operations and management, with insights into where operations should be centralized and when it’s best to decentraliz...
Providing the needed data for application development and testing is a huge headache for most organizations. The problems are often the same across companies - speed, quality, cost, and control. Provisioning data can take days or weeks, every time a refresh is required. Using dummy data leads to quality problems. Creating physical copies of large data sets and sending them to distributed teams of developers eats up expensive storage and bandwidth resources. And, all of these copies proliferating...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
DevOps has often been described in terms of CAMS: Culture, Automation, Measuring, Sharing. While we’ve seen a lot of focus on the “A” and even on the “M”, there are very few examples of why the “C" is equally important in the DevOps equation. In her session at @DevOps Summit, Lori MacVittie, of F5 Networks, explored HTTP/1 and HTTP/2 along with Microservices to illustrate why a collaborative culture between Dev, Ops, and the Network is critical to ensuring success.
Interoute has announced the integration of its Global Cloud Infrastructure platform with Rancher Labs’ container management platform, Rancher. This approach enables enterprises to accelerate their digital transformation and infrastructure investments. Matthew Finnie, Interoute CTO commented “Enterprises developing and building apps in the cloud and those on a path to Digital Transformation need Digital ICT Infrastructure that allows them to build, test and deploy faster than ever before. The int...