Welcome!

Related Topics: @CloudExpo

@CloudExpo: Blog Post

Coraid and ATA-Over-Ethernet Technology

The Key Technology Enabler for Coraid’s Resilient Scalable Architecture

Data server admins are always on the lookout for changes in the industry that will help do their job better, keep their data safer, and speed up file access. The old standbys in recent years have been iSCSI and Fibre Channel. These high-speed technologies have been good matches for storage applications like database use and management where use can be intense. They can, however, be quite costly to keep up and running properly and they require a lot of care and maintenance. A new alternative to iSCSI and Fibre Channel is ATA-Over-Ethernet (AoE).

This open-source connectionless storage networking protocol was originally developed in 2003 by California company, Coraid. It connects servers and storage in a less complex fashion than iSCSI and Fibre Channel. The AoE Layer 2 design works to find the most efficient way to transmit raw disk I/O commands over raw Ethernet. The more connects that are added, the more bandwidth that is made available, the more resilient the pathways. It is important to note that AoE is not iSCSI. The only commonality between AoE and iSCSI is that they both use Ethernet for transport. iSCSI uses TCP/IP at Layer 4 and AoE Layer 2.

Like Fibre Channel, iSCSI is a connection-based topology, which requires sequenced serial delivery of the data packets of the network. No matter how many iSCSI ports you have on your servers and storage, only one can be used at a time to transmit data due to the connection requirement. Other ports can be used in "round robin" to increase throughput.

When transmitting data in an AoE network, jumbo frames should be enabled as it allows each 8K block to occupy a single Ethernet frame for maximum transfer speed. AoE uses all available ports automatically and does not require sessions or sequence numbers. Frames can arrive out of order without an issue.

There have been questions from the admin community as to how secure AoE is as compared to other protocols. Some worry that is isn't as secure as iSCSI since there is no authentication. This, however, is not the case. As AoE is not accessible via a router and must physically connect to the local Ethernet switch, thus greatly reducing the possibility of unauthorized access. You are simply not able to route the packets so people outside don't see your data.

Generally speaking, an AoE setup is two to four times more efficient than iSCSI. And as mentioned previously, it is important to remember that AoE is not simply a variation on the theme of iSCSI. It is its own separate transfer protocol.

So what does this all mean when it comes to day-to-day data management?

It means AoE is a valid alternative to iSCSI and Fibre Channel. With fewer protocol layers, AoE is fast and easy to implement. It provides scalability along with performance.

More Stories By Sara Williams

Sara Williams is a consultant at Coraid. Coraid is a leading provider of network storage solutions. Coraid delivers scale-out performance, Ethernet simplicity, and an elastic storage architecture to handle massive data growth. Designed from the ground up for virtualization and cloud architectures, Coraid's platform has been deployed by more than 1,700 customers worldwide.

Latest Stories
What are the successful IoT innovations from emerging markets? What are the unique challenges and opportunities from these markets? How did the constraints in connectivity among others lead to groundbreaking insights? In her session at @ThingsExpo, Carmen Feliciano, a Principal at AMDG, will answer all these questions and share how you can apply IoT best practices and frameworks from the emerging markets to your own business.
Ask someone to architect an Internet of Things (IoT) solution and you are guaranteed to see a reference to the cloud. This would lead you to believe that IoT requires the cloud to exist. However, there are many IoT use cases where the cloud is not feasible or desirable. In his session at @ThingsExpo, Dave McCarthy, Director of Products at Bsquare Corporation, will discuss the strategies that exist to extend intelligence directly to IoT devices and sensors, freeing them from the constraints of ...
SYS-CON Events announced today the Kubernetes and Google Container Engine Workshop, being held November 3, 2016, in conjunction with @DevOpsSummit at 19th Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA. This workshop led by Sebastian Scheele introduces participants to Kubernetes and Google Container Engine (GKE). Through a combination of instructor-led presentations, demonstrations, and hands-on labs, students learn the key concepts and practices for deploying and maintainin...
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Cloud analytics is dramatically altering business intelligence. Some businesses will capitalize on these promising new technologies and gain key insights that’ll help them gain competitive advantage. And others won’t. Whether you’re a business leader, an IT manager, or an analyst, we want to help you and the people you need to influence with a free copy of “Cloud Analytics for Dummies,” the essential guide to this explosive new space for business intelligence.
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
Traditional IT, great for stable systems of record, is struggling to cope with newer, agile systems of engagement requirements coming straight from the business. In his session at 18th Cloud Expo, William Morrish, General Manager of Product Sales at Interoute, outlined ways of exploiting new architectures to enable both systems and building them to support your existing platforms, with an eye for the future. Technologies such as Docker and the hyper-convergence of computing, networking and sto...
WebRTC is bringing significant change to the communications landscape that will bridge the worlds of web and telephony, making the Internet the new standard for communications. Cloud9 took the road less traveled and used WebRTC to create a downloadable enterprise-grade communications platform that is changing the communication dynamic in the financial sector. In his session at @ThingsExpo, Leo Papadopoulos, CTO of Cloud9, discussed the importance of WebRTC and how it enables companies to focus...
With an estimated 50 billion devices connected to the Internet by 2020, several industries will begin to expand their capabilities for retaining end point data at the edge to better utilize the range of data types and sheer volume of M2M data generated by the Internet of Things. In his session at @ThingsExpo, Don DeLoach, CEO and President of Infobright, discussed the infrastructures businesses will need to implement to handle this explosion of data by providing specific use cases for filterin...
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Enterprise networks are complex. Moreover, they were designed and deployed to meet a specific set of business requirements at a specific point in time. But, the adoption of cloud services, new business applications and intensifying security policies, among other factors, require IT organizations to continuously deploy configuration changes. Therefore, enterprises are looking for better ways to automate the management of their networks while still leveraging existing capabilities, optimizing perf...
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2016 Silicon Valley. The 6thInternet of @ThingsExpo will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Early adopters of IoT viewed it mainly as a different term for machine-to-machine connectivity or M2M. This is understandable since a prerequisite for any IoT solution is the ability to collect and aggregate device data, which is most often presented in a dashboard. The problem is that viewing data in a dashboard requires a human to interpret the results and take manual action, which doesn’t scale to the needs of IoT.
When building large, cloud-based applications that operate at a high scale, it’s important to maintain a high availability and resilience to failures. In order to do that, you must be tolerant of failures, even in light of failures in other areas of your application. “Fly two mistakes high” is an old adage in the radio control airplane hobby. It means, fly high enough so that if you make a mistake, you can continue flying with room to still make mistakes. In his session at 18th Cloud Expo, Lee...
Continuous testing helps bridge the gap between developing quickly and maintaining high quality products. But to implement continuous testing, CTOs must take a strategic approach to building a testing infrastructure and toolset that empowers their team to move fast. Download our guide to laying the groundwork for a scalable continuous testing strategy.