Blog Feed Post

Next-Gen Incident Management: Scripted Infrastructure

The big advantage of configuration management tools like Chef, Puppet, and Ansible is that they turn your data center into “scripted” infrastructure. Instead of wasting hours of your life provisioning and configuring each server manually, you can use a configuration tool that does the dirty work for you.

However, those tools aren’t designed to automate incident management. And that begs the following questions: Why are you handling incident management manually when the rest of your IT operations are scripted? Isn’t it time to integrate incident management into your scripted infrastructure routine? Yes! By taking a scripted infrastructure approach to incident management, you can scale monitoring and alert management just as well as the rest of your operations.

The Problem

First, let’s discuss why a scripted infrastructure approach to incident management is so crucial.

I’ll begin by saying that you shouldn’t be too hard on yourself if you’re still doing incident management manually. You’re not a bad admin, just a victim of circumstance. Until recently, automated incident management solutions haven’t been as readily available as with other spaces, with infrastructure management tools like Chef.

Incident management requirements also haven’t always been as complex as they are today. Your data center ten years ago probably comprised, at most, a few dozen on-premise servers. You could handle incident management there manually.

But today, infrastructure is larger and more complex than ever because of demands around scalability and faster product innovation. You have on-premise bare-metal servers. You have local virtual servers. You have cloud servers, containers, and mobile devices. And with the IoT revolution now in full swing, it’s a safe bet that you soon may have to add refrigerators and microwaves and parking meters to the mix, too.

If you want to do incident management effectively on all of these devices, your strategy needs to scale and eliminate repetitive, manual tasks wherever possible. To accomplish that, you need next-generation incident management solutions that can be automated and scripted in the same way that you automate the configuration of your burgeoning data center infrastructure.

The Solution

Now, let’s talk specifics. To handle incident management effectively in the age of scripted infrastructure, your incident management tools should:

  • Route alerts to the right people, every time, automatically. If there’s a manual step anywhere in notifying the right people of an issue, your process is broken.
  • Escalate incidents automatically. Here again, you can’t wait on a human to manually reassign an issue when people forget to take action, especially if you have a huge infrastructure. Your software needs to be smart enough to do that for you, just as Chef and Puppet are smart enough to configure your servers automatically.
  • Manage alert behavior at scale. Part of what makes infrastructure-scripting tools so handy is that they’re good at making the most efficient use of existing resources. They know where in the cloud to place your virtual servers without asking you, for example. In the same way, your incident management tools should be able to group, suppress, and route alerts to the right services and teams automatically, reducing noise as well as response times.
  • Integrate with ChatOps so that your team can collaborate on incident response without siloing the communications process off from incident management work. Plus, through chatbots, ChatOps can help automate certain response tasks.
  • Support all of your monitoring needs. Chances are that you have multiple monitoring systems in place, like AWS Cloudwatch, Nagios, and Pingdom. To make your incident management truly scalable and automated, these tools need to work together without manual intervention. An incident management strategy that automates alerts from all sources except one is just as problematic as a Puppet infrastructure that configures all of your infrastructure apart from one type of server which you provision by hand. Centralization of all your tools within a solution that enables you to turn events into automated workflows is key.
  • Be up 100% of the time. That may seem obvious, but I make this point as a reminder of why it’s a bad idea to rely solely on on-premises notifications. I loved Nagios as much as the next guy when it was 2002 and the cloud was still just a thing in the sky. But today, if you rely solely on an old-guard tool like Nagios running locally to deliver your alerts, you run the risk of having your incident management system itself go down if there’s a problem with your infrastructure. Using Nagios is good and well, but you should feed its alerts, along with the ones coming from the rest of your monitoring systems, to a centralized cloud-based incident management solution, which will not be affected by problems on your infrastructure.

If you’re used to working solely with legacy alerting and monitoring systems, the demands on this list may seem like fantasies, but they’re not. Incident management software that automates rapid response workflows around all your event data, just as effectively as scripted infrastructure can automate your data center, is here now. And to be far more productive and effective at your job, now’s the time to take advantage of it.

The post Next-Gen Incident Management: Scripted Infrastructure appeared first on PagerDuty.

Read the original blog entry...

More Stories By PagerDuty Blog

PagerDuty’s operations performance platform helps companies increase reliability. By connecting people, systems and data in a single view, PagerDuty delivers visibility and actionable intelligence across global operations for effective incident resolution management. PagerDuty has over 100 platform partners, and is trusted by Fortune 500 companies and startups alike, including Microsoft, National Instruments, Electronic Arts, Adobe, Rackspace, Etsy, Square and Github.

Latest Stories
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. They are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from the core-enabling them to increase efficiency and visibility, improve customer service, and meet compliance requirements.
In his session at 21st Cloud Expo, Michael Burley, a Senior Business Development Executive in IT Services at NetApp, will describe how NetApp designed a three-year program of work to migrate 25PB of a major telco's enterprise data to a new STaaS platform, and then secured a long-term contract to manage and operate the platform. This significant program blended the best of NetApp’s solutions and services capabilities to enable this telco’s successful adoption of private cloud storage and launchi...
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
As hybrid cloud becomes the de-facto standard mode of operation for most enterprises, new challenges arise on how to efficiently and economically share data across environments. In his session at 21st Cloud Expo, Dr. Allon Cohen, VP of Product at Elastifile, will explore new techniques and best practices that help enterprise IT benefit from the advantages of hybrid cloud environments by enabling data availability for both legacy enterprise and cloud-native mission critical applications. By rev...
As popularity of the smart home is growing and continues to go mainstream, technological factors play a greater role. The IoT protocol houses the interoperability battery consumption, security, and configuration of a smart home device, and it can be difficult for companies to choose the right kind for their product. For both DIY and professionally installed smart homes, developers need to consider each of these elements for their product to be successful in the market and current smart homes.
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...
Companies are harnessing data in ways we once associated with science fiction. Analysts have access to a plethora of visualization and reporting tools, but considering the vast amount of data businesses collect and limitations of CPUs, end users are forced to design their structures and systems with limitations. Until now. As the cloud toolkit to analyze data has evolved, GPUs have stepped in to massively parallel SQL, visualization and machine learning.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, will provide a fun and simple way to introduce Machine Leaning to anyone and everyone. Together we will solve a machine learning problem and find an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intellige...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere delivers a more modern architectural approach to storage that doesn't require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbui...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.