Welcome!

Related Topics: Containers Expo Blog

Containers Expo Blog: Article

The Foundation of Cloud Computing Infrastructures: Virtualization

Research Challenges in Cloud Infrastructures for 2009

Ignacio Martín Llorente's Blog

One of the relevant contributions of cloud computing is the Infrastructure as a Service (IaaS) model. There are a number of research challenges in cloud infrastructures that, in my opinion, will need to be addressed in 2009. The open research issues are mainly related to new virtualization technologies to enable efficient, dynamic and scalable Cloud operation and interoperation.

Cloud computing enables the deployment of an entire IT infrastructure without the associated capital costs, paying only for the used capacity. The new “Infrastructure as a Service” paradigm has been introduced to better respond to changing computing demands, so allowing to add and remove capacity in order to meet peak or fluctuating service demands. Amazon Elastic Compute Cloud (Amazon EC2), GoGrid and FlexiScale are examples of cloud providers of elastic capacity, offering an interface for remote management of virtualized server instances within their proprietary infrastructure. These commercial clouds do not provide any detail about the internal management of the virtual machines or the physical infrastructure.

Open source cloud computing tools, such as Eucalyptus and Globus Nimbus, let organizations build and customize there own cloud infrastructure. These relevant tools focus on the client perspective, being fully functional with respect to cloud compatible interfaces and providing higher level functionality for security, contextualization and image management. However, they do not support the dynamic allocation and balance of computing resources among virtual machines to meet the scalable and dynamic computing requirements of enterprise datacenters, such as flexible support for dynamic virtual machine placement and infrastructure management.

The RESERVOIR Project

RESERVOIR is the main European research initiative in virtualized infrastructures and Cloud Computing. RESERVOIR is a joint research programme coordinated by IBM Haifa with 13 European partners: Elsag Datamat, CETIC, OGF.eeig, SAP Research, Sun Microsystems, Telefonica I+D, Thales, Umea University, University College of London, DSA-Research at Universidad Complutense de Marid, University of Lugano and University of Messina. The aim of this project is to develop the open-source technology to enable deployment and management of complex IT services across different administrative domains. Its open-source approach will support the definition of open standards for cloud computing, breaking the lock-in imposed by vendors today and allowing any organization to build its own local or public cloud infrastructure. The first-class management entity is a complex service, as a group of interconnected virtual machines with placement constrains, that can run across different cloud sites, being federation of cloud providers one of its main research challenges.

The cloud infrastructure layer in RESERVOIR is the VEE Management layer, which provides execution of groups of interconnected virtual machines as a service. Its other two main research activities complement this layer to provide service management functionality on top of infrastructure clouds (Service Management ActivityTelefonica I+D) and to provide virtualization platforms with advance functionality for performance and reallocation optimization ( coordinated by VEE Infrastructure Enablement Activity coordinated by IBM Haifa).

In the context of the VEE Management Activity, coordinated by DSA-esearch at UCM, the project is conducting research in cloud infrastructures to meet the main challenges in the dynamic and scalable management of virtual machines in datacenters, such us the efficient management of groups of virtual machines within and across sites, elasticity support to meet variations in service workload, dynamic placement algorithms, architectures and placement heuristics for federation of sites, and enhanced Cloud interfaces.

Private Cloud Infrastructures

A key component in a cloud infrastructure backend is the distributed virtual infrastructure manager (also called internal cloud or distributed VM Manager), which allows the dynamic placement of virtual machines on a pool of physical resources according to business needs. There is a growing interest in the community in these tools for leasing compute capacity from the local infrastructure (see for example the conclusions of the Cisco Cloud Computing Research Symposium by Ruben S. Montero, co-leader of the OpenNebula project at DSA-research, and the cloud computing predictions for the new year by Randy Bias, VP Technology Strategy at GoGrid). The aim of these deployments is not to expose to the world a cloud interface to sell capacity over the Internet, but to provide a dynamic and flexible private infrastructure to run service workloads.

The OpenNebula VM Manager is a core component in the RESERVOIR VEE Management layer that is being enhanced to meet the demanding requirements of the business use cases in the project. This open-source alternative to commercial tools for VM management provides an efficient, dynamic and scalable management of VMs within datacenters, private clouds, involving a large amount of virtual and physical servers. OpenNebula can interface with a remote cloud site, being the only tool able to access on-demand to Amazon EC2 for dynamic scaling the local infrastructure based on actual usage. Furthermore, the integration of OpenNebula and Haizea provides the only distributed virtual infrastructure management solution offering advance reservation of capacity.

Further Research in Cloud Infrastructures

There are many other topics for further research in cloud infrastructures that will be addressed in 2009:

  • Concerning the application of cloud computing, relevant topics are performance and reliability running scientific and business applications in Clouds; content distribution systems using Clouds; and Grid, HPC and data-intensive computing in Clouds.
  • Concerning technologies to enable Cloud Computing, interesting topics are new architectures for Cloud infrastructures; Cloud interfaces, programming models and tools; integration with infrastructures for Grid Computing; SLAs, privacy, security and pricing; management of network capacity; heuristics for energy efficiency and high availability; and advance reservation of capacity.
  • Concerning federation of Cloud Providers, research topics are interoperability and portability between Cloud providers; open business policies framework for relationships between infrastructure providers; and higher value self-awareness, self-knowledge, and self-management capabilities.

Although there exist several commercial clouds selling computing power, there are many open research issues to build the next generation of cloud infrastructures. These topics are mainly related to new technologies to enable efficient, dynamic and scalable Cloud operation and interoperation.

 

More Stories By Ignacio M. Llorente

Dr. Llorente is Director of the OpenNebula Project and CEO & co-founder at C12G Labs. He is an entrepreneur and researcher in the field of cloud and distributed computing, having managed several international projects and initiatives on Cloud Computing, and authored many articles in the leading journals and proceedings books. Dr. Llorente is one of the pioneers and world's leading authorities on Cloud Computing. He has held several appointments as independent expert and consultant for the European Commission and several companies and national governments. He has given many keynotes and invited talks in the main international events in cloud computing, has served on several Groups of Experts on Cloud Computing convened by international organizations, such as the European Commission and the World Economic Forum, and has contributed to several Cloud Computing panels and roadmaps. He founded and co-chaired the Open Grid Forum Working Group on Open Cloud Computing Interface, and has participated in the main European projects in Cloud Computing. Llorente holds a Ph.D in Computer Science (UCM) and an Executive MBA (IE Business School), and is a Full Professor (Catedratico) and the Head of the Distributed Systems Architecture Group at UCM.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Latest Stories
SYS-CON Media announced today that @WebRTCSummit Blog, the largest WebRTC resource in the world, has been launched. @WebRTCSummit Blog offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. @WebRTCSummit Blog can be bookmarked ▸ Here @WebRTCSummit conference site can be bookmarked ▸ Here
In his session at DevOps Summit, Tapabrata Pal, Director of Enterprise Architecture at Capital One, will tell a story about how Capital One has embraced Agile and DevOps Security practices across the Enterprise – driven by Enterprise Architecture; bringing in Development, Operations and Information Security organizations together. Capital Ones DevOpsSec practice is based upon three "pillars" – Shift-Left, Automate Everything, Dashboard Everything. Within about three years, from 100% waterfall, C...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
SYS-CON Events announced today that Addteq will exhibit at SYS-CON's @DevOpsSummit at Cloud Expo New York, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Addteq is one of the top 10 Platinum Atlassian Experts who specialize in DevOps, custom and continuous integration, automation, plugin development, and consulting for midsize and global firms. Addteq firmly believes that automation is essential for successful software releases. Addteq centers its products an...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
SYS-CON Events announced today that IoT Now has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. IoT Now explores the evolving opportunities and challenges facing CSPs, and it passes on some lessons learned from those who have taken the first steps in next-gen IoT services.
SYS-CON Events announced today that WineSOFT will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Based in Seoul and Irvine, WineSOFT is an innovative software house focusing on internet infrastructure solutions. The venture started as a bootstrap start-up in 2010 by focusing on making the internet faster and more powerful. WineSOFT’s knowledge is based on the expertise of TCP/IP, VPN, SSL, peer-to-peer, mob...
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, discussed the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports.
Big Data, cloud, analytics, contextual information, wearable tech, sensors, mobility, and WebRTC: together, these advances have created a perfect storm of technologies that are disrupting and transforming classic communications models and ecosystems. In his session at @ThingsExpo, Erik Perotti, Senior Manager of New Ventures on Plantronics’ Innovation team, provided an overview of this technological shift, including associated business and consumer communications impacts, and opportunities it m...
With billions of sensors deployed worldwide, the amount of machine-generated data will soon exceed what our networks can handle. But consumers and businesses will expect seamless experiences and real-time responsiveness. What does this mean for IoT devices and the infrastructure that supports them? More of the data will need to be handled at - or closer to - the devices themselves.
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
Updating DevOps to the latest production data slows down your development cycle. Probably it is due to slow, inefficient conventional storage and associated copy data management practices. In his session at @DevOpsSummit at 20th Cloud Expo, Dhiraj Sehgal, in Product and Solution at Tintri, will talk about DevOps and cloud-focused storage to update hundreds of child VMs (different flavors) with updates from a master VM in minutes, saving hours or even days in each development cycle. He will also...
SYS-CON Events announced today that Dataloop.IO, an innovator in cloud IT-monitoring whose products help organizations save time and money, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Dataloop.IO is an emerging software company on the cutting edge of major IT-infrastructure trends including cloud computing and microservices. The company, founded in the UK but now based in San Fran...