Click here to close now.


Related Topics: Containers Expo Blog

Containers Expo Blog: Article

The Foundation of Cloud Computing Infrastructures: Virtualization

Research Challenges in Cloud Infrastructures for 2009

Ignacio Martín Llorente's Blog

One of the relevant contributions of cloud computing is the Infrastructure as a Service (IaaS) model. There are a number of research challenges in cloud infrastructures that, in my opinion, will need to be addressed in 2009. The open research issues are mainly related to new virtualization technologies to enable efficient, dynamic and scalable Cloud operation and interoperation.

Cloud computing enables the deployment of an entire IT infrastructure without the associated capital costs, paying only for the used capacity. The new “Infrastructure as a Service” paradigm has been introduced to better respond to changing computing demands, so allowing to add and remove capacity in order to meet peak or fluctuating service demands. Amazon Elastic Compute Cloud (Amazon EC2), GoGrid and FlexiScale are examples of cloud providers of elastic capacity, offering an interface for remote management of virtualized server instances within their proprietary infrastructure. These commercial clouds do not provide any detail about the internal management of the virtual machines or the physical infrastructure.

Open source cloud computing tools, such as Eucalyptus and Globus Nimbus, let organizations build and customize there own cloud infrastructure. These relevant tools focus on the client perspective, being fully functional with respect to cloud compatible interfaces and providing higher level functionality for security, contextualization and image management. However, they do not support the dynamic allocation and balance of computing resources among virtual machines to meet the scalable and dynamic computing requirements of enterprise datacenters, such as flexible support for dynamic virtual machine placement and infrastructure management.


RESERVOIR is the main European research initiative in virtualized infrastructures and Cloud Computing. RESERVOIR is a joint research programme coordinated by IBM Haifa with 13 European partners: Elsag Datamat, CETIC, OGF.eeig, SAP Research, Sun Microsystems, Telefonica I+D, Thales, Umea University, University College of London, DSA-Research at Universidad Complutense de Marid, University of Lugano and University of Messina. The aim of this project is to develop the open-source technology to enable deployment and management of complex IT services across different administrative domains. Its open-source approach will support the definition of open standards for cloud computing, breaking the lock-in imposed by vendors today and allowing any organization to build its own local or public cloud infrastructure. The first-class management entity is a complex service, as a group of interconnected virtual machines with placement constrains, that can run across different cloud sites, being federation of cloud providers one of its main research challenges.

The cloud infrastructure layer in RESERVOIR is the VEE Management layer, which provides execution of groups of interconnected virtual machines as a service. Its other two main research activities complement this layer to provide service management functionality on top of infrastructure clouds (Service Management ActivityTelefonica I+D) and to provide virtualization platforms with advance functionality for performance and reallocation optimization ( coordinated by VEE Infrastructure Enablement Activity coordinated by IBM Haifa).

In the context of the VEE Management Activity, coordinated by DSA-esearch at UCM, the project is conducting research in cloud infrastructures to meet the main challenges in the dynamic and scalable management of virtual machines in datacenters, such us the efficient management of groups of virtual machines within and across sites, elasticity support to meet variations in service workload, dynamic placement algorithms, architectures and placement heuristics for federation of sites, and enhanced Cloud interfaces.

Private Cloud Infrastructures

A key component in a cloud infrastructure backend is the distributed virtual infrastructure manager (also called internal cloud or distributed VM Manager), which allows the dynamic placement of virtual machines on a pool of physical resources according to business needs. There is a growing interest in the community in these tools for leasing compute capacity from the local infrastructure (see for example the conclusions of the Cisco Cloud Computing Research Symposium by Ruben S. Montero, co-leader of the OpenNebula project at DSA-research, and the cloud computing predictions for the new year by Randy Bias, VP Technology Strategy at GoGrid). The aim of these deployments is not to expose to the world a cloud interface to sell capacity over the Internet, but to provide a dynamic and flexible private infrastructure to run service workloads.

The OpenNebula VM Manager is a core component in the RESERVOIR VEE Management layer that is being enhanced to meet the demanding requirements of the business use cases in the project. This open-source alternative to commercial tools for VM management provides an efficient, dynamic and scalable management of VMs within datacenters, private clouds, involving a large amount of virtual and physical servers. OpenNebula can interface with a remote cloud site, being the only tool able to access on-demand to Amazon EC2 for dynamic scaling the local infrastructure based on actual usage. Furthermore, the integration of OpenNebula and Haizea provides the only distributed virtual infrastructure management solution offering advance reservation of capacity.

Further Research in Cloud Infrastructures

There are many other topics for further research in cloud infrastructures that will be addressed in 2009:

  • Concerning the application of cloud computing, relevant topics are performance and reliability running scientific and business applications in Clouds; content distribution systems using Clouds; and Grid, HPC and data-intensive computing in Clouds.
  • Concerning technologies to enable Cloud Computing, interesting topics are new architectures for Cloud infrastructures; Cloud interfaces, programming models and tools; integration with infrastructures for Grid Computing; SLAs, privacy, security and pricing; management of network capacity; heuristics for energy efficiency and high availability; and advance reservation of capacity.
  • Concerning federation of Cloud Providers, research topics are interoperability and portability between Cloud providers; open business policies framework for relationships between infrastructure providers; and higher value self-awareness, self-knowledge, and self-management capabilities.

Although there exist several commercial clouds selling computing power, there are many open research issues to build the next generation of cloud infrastructures. These topics are mainly related to new technologies to enable efficient, dynamic and scalable Cloud operation and interoperation.


More Stories By Ignacio M. Llorente

Dr. Llorente is Director of the OpenNebula Project and CEO & co-founder at C12G Labs. He is an entrepreneur and researcher in the field of cloud and distributed computing, having managed several international projects and initiatives on Cloud Computing, and authored many articles in the leading journals and proceedings books. Dr. Llorente is one of the pioneers and world's leading authorities on Cloud Computing. He has held several appointments as independent expert and consultant for the European Commission and several companies and national governments. He has given many keynotes and invited talks in the main international events in cloud computing, has served on several Groups of Experts on Cloud Computing convened by international organizations, such as the European Commission and the World Economic Forum, and has contributed to several Cloud Computing panels and roadmaps. He founded and co-chaired the Open Grid Forum Working Group on Open Cloud Computing Interface, and has participated in the main European projects in Cloud Computing. Llorente holds a Ph.D in Computer Science (UCM) and an Executive MBA (IE Business School), and is a Full Professor (Catedratico) and the Head of the Distributed Systems Architecture Group at UCM.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

Latest Stories
In his General Session at DevOps Summit, Asaf Yigal, Co-Founder & VP of Product at, explored the value of Kibana 4 for log analysis and provided a hands-on tutorial on how to set up Kibana 4 and get the most out of Apache log files. He examined three use cases: IT operations, business intelligence, and security and compliance. Asaf Yigal is co-founder and VP of Product at log analytics software company In the past, he was co-founder of social-trading platform Currensee, which...
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data...
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership ab...
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, rich desktop and tuned mobile experiences can now be created with a single codebase – without compromising functionality, performance or usability. In his session at DevOps Su...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
In his General Session at 17th Cloud Expo, Bruce Swann, Senior Product Marketing Manager for Adobe Campaign, explored the key ingredients of cross-channel marketing in a digital world. Learn how the Adobe Marketing Cloud can help marketers embrace opportunities for personalized, relevant and real-time customer engagement across offline (direct mail, point of sale, call center) and digital (email, website, SMS, mobile apps, social networks, connected objects).
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new da...
In recent years, at least 40% of companies using cloud applications have experienced data loss. One of the best prevention against cloud data loss is backing up your cloud data. In his General Session at 17th Cloud Expo, Sam McIntyre, Partner Enablement Specialist at eFolder, presented how organizations can use eFolder Cloudfinder to automate backups of cloud application data. He also demonstrated how easy it is to search and restore cloud application data using Cloudfinder.
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, exploreed the current state of IoT connectivity and review key trends and t...
Two weeks ago (November 3-5), I attended the Cloud Expo Silicon Valley as a speaker, where I presented on the security and privacy due diligence requirements for cloud solutions. Cloud security is a topical issue for every CIO, CISO, and technology buyer. Decision-makers are always looking for insights on how to mitigate the security risks of implementing and using cloud solutions. Based on the presentation topics covered at the conference, as well as the general discussions heard between sessi...
We all know that data growth is exploding and storage budgets are shrinking. Instead of showing you charts on about how much data there is, in his General Session at 17th Cloud Expo, Scott Cleland, Senior Director of Product Marketing at HGST, showed how to capture all of your data in one place. After you have your data under control, you can then analyze it in one place, saving time and resources.
With all the incredible momentum behind the Internet of Things (IoT) industry, it is easy to forget that not a single CEO wakes up and wonders if “my IoT is broken.” What they wonder is if they are making the right decisions to do all they can to increase revenue, decrease costs, and improve customer experience – effectively the same challenges they have always had in growing their business. The exciting thing about the IoT industry is now these decisions can be better, faster, and smarter. Now ...
The cloud. Like a comic book superhero, there seems to be no problem it can’t fix or cost it can’t slash. Yet making the transition is not always easy and production environments are still largely on premise. Taking some practical and sensible steps to reduce risk can also help provide a basis for a successful cloud transition. A plethora of surveys from the likes of IDG and Gartner show that more than 70 percent of enterprises have deployed at least one or more cloud application or workload. Y...