Welcome!

Blog Feed Post

Hardware By Hand

Raid_controllerhttp://www.stacki.com/wp-content/uploads/2016/05/Raid_controller-768x437... 768w, http://www.stacki.com/wp-content/uploads/2016/05/Raid_controller-1024x58... 1024w, http://www.stacki.com/wp-content/uploads/2016/05/Raid_controller.jpg 1265w" sizes="(max-width: 300px) 100vw, 300px" />The world of datacenter automation is a complex one. We all knew that going into it, but faced with the reality of varying hardware, operating systems, networks, security tools, programming languages, app servers… The list goes on, while we have conquered the general provisioning tasks, we have now to figure out what to do with the complex fiddly bits.

Recently on Twitter, we were discussing how hardware incompatibilities are a thorn in the side of any automation project, including DevOps. Let’s say you’ve set up a state-of-the-art provisioning system that will spin up VMs, containers, or a physical server and provision application A on it. So far, so good. We want easy, stable, repeatable processes to roll out software and services.

But then you have a piece of hardware (be it a server going to support VMware, a compute node added to OpenStack, or a stand-alone app server) that is out of date. Out of date means a lot of things, we’ll focus on two killers – in need of a BIOS update, and in need of a RAID card firmware update. There are others, firmware on networking and SSD cards (particularly specialized ones), hardware replacement – like swapping out RAID cards – etc. We’ll stick with two to explore the problems, but it’s good to keep in mind this is in the context of a broader topic.

The problem with this bit of the automation domain is that everybody does it a little differently, and most still are designed to have a person be sitting there to perform the update (there are entire pages dedicated to the different methods of SSD firmware upgrade alone). Which is very contrarian to full datacenter automation.

The level of support provided by server provisioning vendors ranges from none (you are expected to continue doing this configuration by hand) to nascent. While support for some specific products/families has been around in this server provisioning software or that, none has a comprehensive solution to hardware upgrade/configuration. That makes sense, both because there is no standard in the hardware interfaces, and because there is a steady change in the interfaces required. SSD firmware updating wasn’t a concern until the last few years, for example.

So what do you do? Two things. First, add support for your preferred hardware to your checklist for server provisioning. While you may not need a comprehensive solution, getting to 70 or 80% of affected servers using automation saves a massive amount of time. Secondly, demand that your chosen vendor be doing more in this space. While it is unfair to take server provisioning vendors to task for the hardware vendors’ inability to create a usable standard, the server provisioning vendors know the market they are in, and are well aware that they need to be working on it. Alternative to these two options is going 100% public cloud or hosted servers. Then server provisioning – at least the hardware part of server provisioning – is no longer necessary because your cloud provider will be dealing with hardware. Internal cloud and virtualization still leave the physical servers in your domain, and thus still an issue to wrestle with.

At this point in time, the “hardware layer” of server provisioning is the least well served. While that will no doubt get better over time, it underpins other server provisioning tools, which assume the hardware is ready to rock. Some tools can do configuration of this or that part – the stacki project, of which I am a member, can do about 70% of RAID cards (based upon Avago market share estimated at 80% by an analyst friend, and differences in individual card configuration options). I offer this tidbit up because the tool has some of the broadest (if not the broadest) coverage in the market, and yet isn’t that universal yet.

Longer term, a standardized API to make hardware more easily programmable should be the goal. Underlying implementation can still be proprietary, but a standard interface that can be used to update or configure all products in a given space should be what we’re shooting for.

Sound fantastical? Think I’m dreaming? Well network hardware vendors are slowly moving to programmability and away from secret knowledge. Five years ago that would have been seen as fantastical also. That long ago, some vendors like F5 Networks had APIs, but the APIs mirrored their command lines, keeping the product-specific knowledge requirements. Their current REST API is better organized and less atomic. So I contend that if networking companies can move that direction, so can RAID and BIOS vendors.

Until then, tools that do a “good enough” job of it, and the occasional manual intervention will be the best we can manage, but it’s still far better than doing it all by hand.

Read the original blog entry...

More Stories By Don MacVittie

Don MacVittie is founder of Ingrained Technology, A technical advocacy and software development consultancy. He has experience in application development, architecture, infrastructure, technical writing,DevOps, and IT management. MacVittie holds a B.S. in Computer Science from Northern Michigan University, and an M.S. in Computer Science from Nova Southeastern University.

Latest Stories
SYS-CON Events announced today that Loom Systems will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2015, Loom Systems delivers an advanced AI solution to predict and prevent problems in the digital business. Loom stands alone in the industry as an AI analysis platform requiring no prior math knowledge from operators, leveraging the existing staff to succeed in the digital era. With offices in ...
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...
Peak 10 has announced that it has completed a 20,000 square foot expansion of its Cincinnati-area data center, a 6,000 square foot expansion of its data center campus in Charlotte’s University Research Park, and added a pair of seasoned executives to its leadership team. This further propels the company on its aggressive growth trajectory to meet the rising demand for flexible hybrid IT strategies and solutions across its enterprise customer base. Cincinnati is home to companies like Kroger, Pr...
VeriStor Systems has announced that CRN has named VeriStor to its 2017 Managed Service Provider (MSP) 500 list in the Elite 150 category. This annual list recognizes North American solution providers with cutting-edge approaches to delivering managed services. Their offerings help companies navigate the complex and ever-changing landscape of IT, improve operational efficiencies, and maximize their return on IT investments. In today’s fast-paced business environments, MSPs play an important role...
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloudistics delivers a complete public cloud experience with composable on-premises infrastructures to medium and large enterprises. Its software-defined technology natively converges network, storage, compute, virtualization, and management into a ...
SYS-CON Events announced today that Infranics will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Since 2000, Infranics has developed SysMaster Suite, which is required for the stable and efficient management of ICT infrastructure. The ICT management solution developed and provided by Infranics continues to add intelligence to the ICT infrastructure through the IMC (Infra Management Cycle) based on mathemat...
Virtualization over the past years has become a key strategy for IT to acquire multi-tenancy, increase utilization, develop elasticity and improve security. And virtual machines (VMs) are quickly becoming a main vehicle for developing and deploying applications. The introduction of containers seems to be bringing another and perhaps overlapped solution for achieving the same above-mentioned benefits. Are a container and a virtual machine fundamentally the same or different? And how? Is one techn...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
Have you ever noticed how some IT people seem to lead successful, rewarding, and satisfying lives and careers, while others struggle? IT author and speaker Don Crawley uncovered the five principles that successful IT people use to build satisfying lives and careers and he shares them in this fast-paced, thought-provoking webinar. You'll learn the importance of striking a balance with technical skills and people skills, challenge your pre-existing ideas about IT customer service, and gain new in...
"I think that everyone recognizes that for IoT to really realize its full potential and value that it is about creating ecosystems and marketplaces and that no single vendor is able to support what is required," explained Esmeralda Swartz, VP, Marketing Enterprise and Cloud at Ericsson, in this SYS-CON.tv interview at @ThingsExpo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new da...
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor - all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
What if you could build a web application that could support true web-scale traffic without having to ever provision or manage a single server? Sounds magical, and it is! In his session at 20th Cloud Expo, Chris Munns, Senior Developer Advocate for Serverless Applications at Amazon Web Services, will show how to build a serverless website that scales automatically using services like AWS Lambda, Amazon API Gateway, and Amazon S3. We will review several frameworks that can help you build serverle...
Deep learning has been very successful in social sciences and specially areas where there is a lot of data. Trading is another field that can be viewed as social science with a lot of data. With the advent of Deep Learning and Big Data technologies for efficient computation, we are finally able to use the same methods in investment management as we would in face recognition or in making chat-bots. In his session at 20th Cloud Expo, Gaurav Chakravorty, co-founder and Head of Strategy Development ...