Welcome!

Blog Feed Post

Further Thoughts on VVOLS

Following on from my first post on VVOLs, I did a little research on the two technology previews that had been presented at this and last year’s VMworld – sessions INF-STO2223 & VSP3205 respectively.  The sessions fill in a few background ideas and seem to have evolved slightly over the past 12 months.  Here are some of the contents.

I/O Demux

The I/O Demultiplexer is a way to simplify connectivity between the VM and storage array.  In the latest presentation, the I/O Demux has been relabelled Protocol Endpoint and should be either SCSI or NFS compliant (I suspect they mean more agnostic).  As I mentioned previously, unless VMware are talking about fundamentally redesigning the SCSI protocol, then for block-storage there still needs to be the concept of initiator and target to represent host and storage.  Both presentations are at pains to point out that the I/O Demux is not a LUN or mount point so exactly what is it?

Capacity Pools

A capacity pool is a logical pooling of storage set up by the storage administrator, from which the VMware admin can create VVOLs.  This means responsibility for pool creation (it’s layout, location, performance) stays with the storage team, but the virtualisation team have the flexibility to allocate VVOLs on demand within that pool of capacity.  In most respects, it seems that a capacity pool is no more than today’s VMFS LUN or an NFS share/mount point, but is consistently named across both protocols.

Vendor Provider

Array communication will be managed by a new Vendor Provider plugin on the storage system.  Previously this was described as a Data Management Extension.  I’m never comfortable about array-based vendor plugins as I think they are usually a kludge to make two incompatible devices work together.  To me the vendor provider already has the smell of an SMI-S provider.  These never get natively implemented and are usually sitting on a management server that has to be available for the storage admin to manage the array.  VMware need to be clear about whether this provider will be native or not, as it only introduces additional complications.  Of course the vendor provider plugin is needed probably because neither SCSI nor NFS protocols could be modified to provide the additional management commands VMware wanted or needed.

Actual Implementations

As I mentioned in my previous article, I can see how VVOLs could be easily implemented on NAS systems.  In fact, Tintri already provide the VVOL features on their arrays today.  I took the time at VMworld to chat to Tintri co-founder, Kieran Harty to get his view on the VVOL technology and how it might affect them.  In his view, VVOLs will take another 18-24 months to fully mature, in which time Tintri already have a lead in the product they are shipping today.  However it’s also true to say that today’s NAS vendors could easily add code that recognises the file comprising a VM.

From a block perspective, the spectre of SCSI LUN count still looms.  I expect the IO Demux is a fix to get around this problem.  VMFS LUNs will be renamed capacity pools and VVOLs will be sub-LUN objects.  Hardware Assisted Locking introduced in vSphere 4.1 enables locking of parts of a VMFS in a much more efficient fashion (i.e. locking the parts of the VMFS that represent a VVOL).  All that’s missing to deliver VVOLs is a way of mapping exactly which VMFS blocks belong to a VVOL and ensuring the host and storage array both know this level of detail.  One issue that still stands out here is in delivering QoS (Quality of Service).  Today a VM can be moved to a VMFS that offers a specific service level in terms of performance and capacity.  As that VMFS is a LUN, then I/O attributes in the array are easily set at the VMFS/LUN level.  This includes I/O processing at the storage port on the storage array.  Command Tag Queuing enables I/O processing to be optimised by reordering the processing of queued I/O requests when there are multiple LUNS on a shared storage port.

However, if a VMFS stays as a LUN and VVOLs are logical subdivisions of a LUN, then somehow additional QoS information needs to be provided to the array in order for it to determine which priority order to process requests.  Today that’s done by LUN, but a more granular approach will be needed.  How will this be achieved?  Will the array simply know the LBA address ranges for each VVOL and use that information?  Even if this is the case, today’s storage arrays will require significant engineering changes to make this work and what’s not clear is how a shared array with non-VMware storage will inter-operate.

As a side note, HP have released a preview of an HP 3PAR system working with VVOL storage.  You can find the video through Calvin Zito’s blog at HP.

The Architect’s View

VVOLs could certainly be a step forward and I’m relishing understanding the full technical details.  The concept is a good thing as it abstracts storage specifics from the virtualisation admin.  At this stage there are still too many unknowns to determine how easy VVOLS will be to implement, however VMware will no doubt make them a mandatory part of vSphere in the future, so we better get used to dealing with them now.

 Related Links

Comments are always welcome; please indicate if you work for a vendor as it’s only fair.  If you have any related links of interest, please feel free to add them as a comment for consideration.

Read the original blog entry...

Latest Stories
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
You know you need the cloud, but you're hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You're looking at private cloud solutions based on hyperconverged infrastructure, but you're concerned with the limits inherent in those technologies. What do you do?
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
Recently, WebRTC has a lot of eyes from market. The use cases of WebRTC are expanding - video chat, online education, online health care etc. Not only for human-to-human communication, but also IoT use cases such as machine to human use cases can be seen recently. One of the typical use-case is remote camera monitoring. With WebRTC, people can have interoperability and flexibility for deploying monitoring service. However, the benefit of WebRTC for IoT is not only its convenience and interopera...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams. In his session at 22nd Cloud Expo | DXWorld Expo, Daniel Jones, CTO of EngineerBetter, will answer: How can we improve willpower and decrease technical debt? Is the present bias real? How can we turn it to our advantage? Can you increase a team’s effective IQ? How do DevOps & Product Teams increase empathy, and what impact does empath...
"I focus on what we are calling CAST Highlight, which is our SaaS application portfolio analysis tool. It is an extremely lightweight tool that can integrate with pretty much any build process right now," explained Andrew Siegmund, Application Migration Specialist for CAST, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close th...