Welcome!

Blog Feed Post

What is 25 Gigabit Ethernet and why would you want it?

In the past few weeks you may have seen several press releases and articles talking about 25 Gbit Ethernet. Just when you got used to ethernet speeds being a nice decimal based system where we simply add zeros every few years, someone threw in 40GbE a few years ago. And that’s ok, powers of two we can deal with, but 25? That just does not fit in our mental model of Ethernet.

SerDes

The driving force behind 25GbE Ethernet is actually fairly simple and straightforward. If you open up an ethernet switch (small, large, does not really matter), you will find that all the high speed components are connected using serial links called SerDes, the rather boring concatenation of SERializer and DESerializer. The serializer is a piece of logic that takes data to be transferred and serializes it, the deserializer sits on the receiving side and reconstructs the serial stream of bits back into data for the ultimate receiver. Between the two, there are some basic encoding mechanisms to keep their clocks synchronized, some basic framing and a few other things. Google for 64B/66B encoding if you really want to understand the gory details.

Gigabit and 10Gigabit ethernet runs over these SerDes connections between components. In a typical 10GbE Top of Rack like switch, the Ethernet switching chip (everyone has heard of Trident2 as the market leading chipset in use today), the actual ethernet ports are SerDes connections coming from the chip (128 of them for Trident2, each representing a 10GbE equivalent port). These connections are then used to connect to other Ethernet of fabric chips (in the case of chassis based systems), or directly to the cages SFP+ and QSFP optics plug into. Communication between an SFP+ in the front of the switch and the switching chip runs on top of one of these SerDes connections.

As you probably figured out, the components used in today’s switches all run SerDes with a clock rate around 12.5Ghz, providing that 10Gbit transfer rate between the components across each (allowing for the encoding overhead). Until recently, that speed was about the state of the art to run these serial links across short distances (this is all inside of a single device) within acceptable signal loss and cross talk ranges. Signal integrity is not one of my strong points, so that’s about the best explanation I will give you.

10 to 40 to 100

With that 10Gbit building block we have created higher speed interfaces. When you look at a 40GbE interface, it is constructed out of 4 parallel SerDes links between the Ethernet chip and the QSFP pluggable. Even when leaving the QSFP onto fiber, it takes 4 parallel 10Gbit streams to transport this to the receiving QSFP. The short reach QSFP interfaces use 4 pair of fiber between them, and their copper Direct Attach Cable (DAC) equivalent carry the same on several copper cables inside the big cable. Longer reach QSFP interfaces put the 4 10Gbit streams onto separate Wave Division Multiplexing (WDM) waves which can be carried over a single pair of fiber. This is part of the reason why QSFP optics are fairly expensive still, especially for longer distances. Distribution of the bits across these parallel paths is done on almost a bit by bit basis by the hardware and has nothing to do with the packet based distribution we know in Ethernet.

Similarly for the 100GbE interfaces that are available today, these are really constructed out of 10 parallel paths of 10Gbit streams. Similar to the 40GbE example above, these are carried across 10 pair of fiber, or multiplexed together into a single fiber. Of course that also comes at a cost.

In the past 2-3 years, technology has advanced to the point that 25Ghz SerDes have become economically viable, and all of the usual physics problems in signal integrity have found solutions. This now means that  we can push data 2.5 times as fast across those serial links, and ethernet chipsets due in the next year will start to have 25Ghz SerDes ports on them rather than 12.5Ghz ports. Once you have these ports, you can of course still run 10GbE across it, but you would not use all the capacity of that connection. 40GbE will then have the option to run across 2 parallel 25Ghz SerDes, rather than the 4 required today. And that translates into less cabling between devices. Similarly, 100GbE will move away from the current 10×10 implementations rather quickly to 4×25, for the very same reasons. Less parallel paths, less fibers, less optics, less everything.

Which then leaves the question, if there is this basic 25Ghz building block that we intend to use for 40GbE and 100GbE, why would we not want to use it in and by itself for 25GbE. As a single signal, it would provide a 2.5 performance boost in an SFP+ form factor without doing anything complicated. It’s like taking 10GbE and simply run it faster, one the hardest part has been solved, running a serial signal that fast.

And then there is 25

And there is your long winded but rather straightforward reason for 25Gbit Ethernet. Independent of ethernet, serial I/O technology has created an extremely useful building block that runs much faster than its predecessor. IEEE in its standardization of 100GbE already assumed 25Ghz serial I/O capabilities and has layered its definition of 100GbE on top it (the 10×10 available today is mostly a placeholder, make sure you ask your vendor what flavor of 100GbE they provide). But that same IEEE never went back to re-apply that 25Ghz technology to 10GbE and 40GbE and turn it into 25GbE and 50GbE. With lots of the foundational work done as part of the 100GbE specifications, this is not the tremendous 4-5 year effort that most IEEE standards efforts take.

The vendor industry has taken it on themselves to move this along outside of IEEE with a 25GbE consortium. There are several parts and components required to create complete 25GbE ethernet solutions. The ethernet chips will start to have them within a year, we then also need pluggable optics and perhaps even Direct Attach Cables to support the native 25GbE and its 50GbE sister, and of course server NIC cards need to support this as well. This is one of these efforts that requires a relatively small development across all of these components (emphasis on relatively) with a fairly quick 2.5x performance payoff at the end. As a consumer, 25GbE and 50GbE provide will provide you with a substantial performance boost in your datacenter server and storage environment with less cabling at a cost that in my opinion will get to small premiums over 10GbE fairly quickly over the next few years.

At Plexxi we fully support the 25GbE efforts, there is very little if anything negative associated with the push to productization. We will quickly embrace ethernet chipsets that support 25Ghz SerDes and the optical components that help us drive our optical fabric to higher capacities. The IEEE has always been the one and only standardization body for anything Ethernet, but it has been sent a clear message by the industry to move a lot faster. I have no doubt that that same industry will drive 25GbE to commercial success because it just makes sense.

[Today's fun fact: Over 50 percent of your body heat is lost through your head and neck. That is a very useful fact for us here in the Northeast.]

The post What is 25 Gigabit Ethernet and why would you want it? appeared first on Plexxi.

Read the original blog entry...

More Stories By Marten Terpstra

Marten Terpstra is a Product Management Director at Plexxi Inc. Marten has extensive knowledge of the architecture, design, deployment and management of enterprise and carrier networks.

Latest Stories
It's easy to assume that your app will run on a fast and reliable network. The reality for your app's users, though, is often a slow, unreliable network with spotty coverage. What happens when the network doesn't work, or when the device is in airplane mode? You get unhappy, frustrated users. An offline-first app is an app that works, without error, when there is no network connection.
Data-as-a-Service is the complete package for the transformation of raw data into meaningful data assets and the delivery of those data assets. In her session at 18th Cloud Expo, Lakshmi Randall, an industry expert, analyst and strategist, will address: What is DaaS (Data-as-a-Service)? Challenges addressed by DaaS Vendors that are enabling DaaS Architecture options for DaaS
One of the bewildering things about DevOps is integrating the massive toolchain including the dozens of new tools that seem to crop up every year. Part of DevOps is Continuous Delivery and having a complex toolchain can add additional integration and setup to your developer environment. In his session at @DevOpsSummit at 18th Cloud Expo, Miko Matsumura, Chief Marketing Officer of Gradle Inc., will discuss which tools to use in a developer stack, how to provision the toolchain to minimize onboa...
SYS-CON Events announced today that Catchpoint Systems, Inc., a provider of innovative web and infrastructure monitoring solutions, has been named “Silver Sponsor” of SYS-CON's DevOps Summit at 18th Cloud Expo New York, which will take place June 7-9, 2016, at the Javits Center in New York City, NY. Catchpoint is a leading Digital Performance Analytics company that provides unparalleled insight into customer-critical services to help consistently deliver an amazing customer experience. Designed...
With the proliferation of both SQL and NoSQL databases, organizations can now target specific fit-for-purpose database tools for their different application needs regarding scalability, ease of use, ACID support, etc. Platform as a Service offerings make this even easier now, enabling developers to roll out their own database infrastructure in minutes with minimal management overhead. However, this same amount of flexibility also comes with the challenges of picking the right tool, on the right ...
CIOs and those charged with running IT Operations are challenged to deliver secure, audited, and reliable compute environments for the applications and data for the business. Behind the scenes these tasks are often accomplished by following onerous time-consuming processes and often the management of these environments and processes will be outsourced to multiple IT service providers. In addition, the division of work is often siloed into traditional "towers" that are not well integrated for cro...
SYS-CON Events announced today that FalconStor Software® Inc., a 15-year innovator of software-defined storage solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. FalconStor Software®, Inc. (NASDAQ: FALC) is a leading software-defined storage company offering a converged, hardware-agnostic, software-defined storage and data services platform. Its flagship solution FreeStor®, utilizes a horizonta...
With an estimated 50 billion devices connected to the Internet by 2020, several industries will begin to expand their capabilities for retaining end point data at the edge to better utilize the range of data types and sheer volume of M2M data generated by the Internet of Things. In his session at @ThingsExpo, Don DeLoach, CEO and President of Infobright, will discuss the infrastructures businesses will need to implement to handle this explosion of data by providing specific use cases for filte...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Avere delivers a more modern architectural approach to storage that doesn’t require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbuilding of data centers ...
SYS-CON Events announced today that Pythian, a global IT services company specializing in helping companies adopt disruptive technologies to optimize revenue-generating systems, has been named “Bronze Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. Founded in 1997, Pythian is a global IT services company that helps companies compete by adopting disruptive technologies such as cloud, Big Data, advanced analytics, and DevO...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management...
SYS-CON Events announced today that Alert Logic, Inc., the leading provider of Security-as-a-Service solutions for the cloud, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Alert Logic, Inc., provides Security-as-a-Service for on-premises, cloud, and hybrid infrastructures, delivering deep security insight and continuous protection for customers at a lower cost than traditional security solutions. Ful...
SYS-CON Events announced today that Column Technologies will exhibit at SYS-CON's @DevOpsSummit at Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Established in 1998, Column Technologies is a global technology solutions provider with over 400 employees, headquartered in the United States with offices in Canada, India, and the United Kingdom. Column Technologies provides “Best of Breed” technology solutions that automate the key DevOps principal...
SYS-CON Events announced today that Interoute, owner-operator of one of Europe's largest networks and a global cloud services platform, has been named “Bronze Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. Interoute is the owner-operator of one of Europe's largest networks and a global cloud services platform which encompasses 12 data centers, 14 virtual data centers and 31 colocation centers, with connections to 195 ad...
The Quantified Economy represents the total global addressable market (TAM) for IoT that, according to a recent IDC report, will grow to an unprecedented $1.3 trillion by 2019. With this the third wave of the Internet-global proliferation of connected devices, appliances and sensors is poised to take off in 2016. In his session at @ThingsExpo, David McLauchlan, CEO and co-founder of Buddy Platform, will discuss how the ability to access and analyze the massive volume of streaming data from mil...