Blog Feed Post

Next-Gen Incident Management: Scripted Infrastructure

The big advantage of configuration management tools like Chef, Puppet, and Ansible is that they turn your data center into “scripted” infrastructure. Instead of wasting hours of your life provisioning and configuring each server manually, you can use a configuration tool that does the dirty work for you.

However, those tools aren’t designed to automate incident management. And that begs the following questions: Why are you handling incident management manually when the rest of your IT operations are scripted? Isn’t it time to integrate incident management into your scripted infrastructure routine? Yes! By taking a scripted infrastructure approach to incident management, you can scale monitoring and alert management just as well as the rest of your operations.

The Problem

First, let’s discuss why a scripted infrastructure approach to incident management is so crucial.

I’ll begin by saying that you shouldn’t be too hard on yourself if you’re still doing incident management manually. You’re not a bad admin, just a victim of circumstance. Until recently, automated incident management solutions haven’t been as readily available as with other spaces, with infrastructure management tools like Chef.

Incident management requirements also haven’t always been as complex as they are today. Your data center ten years ago probably comprised, at most, a few dozen on-premise servers. You could handle incident management there manually.

But today, infrastructure is larger and more complex than ever because of demands around scalability and faster product innovation. You have on-premise bare-metal servers. You have local virtual servers. You have cloud servers, containers, and mobile devices. And with the IoT revolution now in full swing, it’s a safe bet that you soon may have to add refrigerators and microwaves and parking meters to the mix, too.

If you want to do incident management effectively on all of these devices, your strategy needs to scale and eliminate repetitive, manual tasks wherever possible. To accomplish that, you need next-generation incident management solutions that can be automated and scripted in the same way that you automate the configuration of your burgeoning data center infrastructure.

The Solution

Now, let’s talk specifics. To handle incident management effectively in the age of scripted infrastructure, your incident management tools should:

  • Route alerts to the right people, every time, automatically. If there’s a manual step anywhere in notifying the right people of an issue, your process is broken.
  • Escalate incidents automatically. Here again, you can’t wait on a human to manually reassign an issue when people forget to take action, especially if you have a huge infrastructure. Your software needs to be smart enough to do that for you, just as Chef and Puppet are smart enough to configure your servers automatically.
  • Manage alert behavior at scale. Part of what makes infrastructure-scripting tools so handy is that they’re good at making the most efficient use of existing resources. They know where in the cloud to place your virtual servers without asking you, for example. In the same way, your incident management tools should be able to group, suppress, and route alerts to the right services and teams automatically, reducing noise as well as response times.
  • Integrate with ChatOps so that your team can collaborate on incident response without siloing the communications process off from incident management work. Plus, through chatbots, ChatOps can help automate certain response tasks.
  • Support all of your monitoring needs. Chances are that you have multiple monitoring systems in place, like AWS Cloudwatch, Nagios, and Pingdom. To make your incident management truly scalable and automated, these tools need to work together without manual intervention. An incident management strategy that automates alerts from all sources except one is just as problematic as a Puppet infrastructure that configures all of your infrastructure apart from one type of server which you provision by hand. Centralization of all your tools within a solution that enables you to turn events into automated workflows is key.
  • Be up 100% of the time. That may seem obvious, but I make this point as a reminder of why it’s a bad idea to rely solely on on-premises notifications. I loved Nagios as much as the next guy when it was 2002 and the cloud was still just a thing in the sky. But today, if you rely solely on an old-guard tool like Nagios running locally to deliver your alerts, you run the risk of having your incident management system itself go down if there’s a problem with your infrastructure. Using Nagios is good and well, but you should feed its alerts, along with the ones coming from the rest of your monitoring systems, to a centralized cloud-based incident management solution, which will not be affected by problems on your infrastructure.

If you’re used to working solely with legacy alerting and monitoring systems, the demands on this list may seem like fantasies, but they’re not. Incident management software that automates rapid response workflows around all your event data, just as effectively as scripted infrastructure can automate your data center, is here now. And to be far more productive and effective at your job, now’s the time to take advantage of it.

The post Next-Gen Incident Management: Scripted Infrastructure appeared first on PagerDuty.

Read the original blog entry...

More Stories By PagerDuty Blog

PagerDuty’s operations performance platform helps companies increase reliability. By connecting people, systems and data in a single view, PagerDuty delivers visibility and actionable intelligence across global operations for effective incident resolution management. PagerDuty has over 100 platform partners, and is trusted by Fortune 500 companies and startups alike, including Microsoft, National Instruments, Electronic Arts, Adobe, Rackspace, Etsy, Square and Github.

Latest Stories
DXWorldEXPO LLC announced today that Kevin Jackson joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Kevin L. Jackson is a globally recognized cloud computing expert and Founder/Author of the award winning "Cloud Musings" blog. Mr. Jackson has also been recognized as a "Top 100 Cybersecurity Influencer and Brand" by Onalytica (2015), a Huffington Post "Top 100 Cloud Computing Experts on Twitter" (2013) and a "Top 50 C...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER give you detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPO also offers s...
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Daniel Jones is CTO of EngineerBetter, helping enterprises deliver value faster. Previously he was an IT consultant, indie video games developer, head of web development in the finance sector, and an award-winning martial artist. Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams.
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory? In her Day 2 Keynote at @DevOpsSummit at 21st Cloud Expo, Aruna Ravichandran, VP, DevOps Solutions Marketing, CA Technologies, was jo...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Evan Kirstel is an internationally recognized thought leader and social media influencer in IoT (#1 in 2017), Cloud, Data Security (2016), Health Tech (#9 in 2017), Digital Health (#6 in 2016), B2B Marketing (#5 in 2015), AI, Smart Home, Digital (2017), IIoT (#1 in 2017) and Telecom/Wireless/5G. His connections are a "Who's Who" in these technologies, He is in the top 10 most mentioned/re-tweeted by CMOs and CIOs (2016) and have been recently named 5th most influential B2B marketeer in the US. H...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.