Blog Feed Post

Control Costs: Keep Track of Test Environments

Test environments cost money; this is the inescapable fact of test environment management. It can be difficult to justify the expense in your conversations with finance and management, especially if they lack a software development background. Businesses are often fine with dropping millions on production infrastructure because there’s a direct line between keeping production running and revenue. On the other hand, QA environments are often viewed by management as unnecessary overhead. Why do we need all these QA environments?

I’ve even spoken with an executive who viewed increased spending on test environments as a negative. His mistaken assumption was that his company was forced to spend money on test environments because his developers wrote buggy code. It was the first time I had heard such an incorrect assumption, but I wasn’t surprised. “IT” is still a mystery to most senior executives and the idea that testing is only necessary because programmers write bad code merely reflects the inexperience this company had with software development.

For test environments, your best arguments for an increased test environment spend are quality and agility. Test environment numbers are directly related to the quality of customer experience in production. That being said, it is still an uphill battle. Test environments are overhead, and CFOs can be skeptical of the return on investment. In the next few blogs, I’m going to focus on tools you can use to reduce test environment cost. Here’s the first suggestion.

Keep Close Track of Test Environment Allocation

A poorly executed test environment management effort is a “fire-and-forget” operation. Managers allocate environments to projects, projects are left on their own to manage infrastructure, and environments are rarely reclaimed. In these organizations the test environment management team doesn’t manage environments, they simply hand out hardware to development teams without measuring any metrics. A group that just hands out hardware in an IT department is akin to a free candy store; everyone will show up asking for an unlimited number of “test environments.”

This model leads to inefficiency. Organizations not keeping a close eye on test environment allocation fail to understand which environments are being used. When a TEM just hands out capacity and infrastructure to development groups, there is no economic or market pressure to use environments efficiently. Teams just ask for environments and sit on them, even if they aren’t being used. Have you used this test environment in the last year? I’m not sure.”

That’s not a Test Environment, That’s a Secret Project

So high-profile projects might end up with twelve QA environments, all requested under the pretense that this project needed to support twelve simultaneous development streams. This is usually not the case. Even the largest, most complex projects in the industry can only successfully build on three parallel development tracks for version N, N+1, and (maybe) N+2. But, this sort of parallel development is full of risks and coordination challenges. If a team has twelve QA environments, in reality, this team likely uses QA environments to support personal development branches and other systems unrelated to QA testing. For example, one of our clients handed out thirteen QA environments to a single project, only to realize that the project had repurposed some of this infrastructure to another internal project that was being developed “off the books.” What was intended to be used as QA infrastructure was repurposed as CI/CD infrastructure for a secret project they were going to propose for next year’s budget. In this way, the test environment management budget was being used to support another department’s secret infrastructure.

If your organization is large enough, and you start using Plutora to keep track of test environments, there’s a good chance you’ll find entire racks full of hardware being used to support “testing.” But in reality, they are being used to support non-standard build pipelines, custom developer environments, and other uses that aren’t properly tracked. (And, some of these systems may be necessary, but they shouldn’t be tracked against your test environment budget.)

Fail to Keep Track of Test Environments: Pay a Penalty

Organizations that don’t use Plutora to keep track of test environment use are often paying many times what they should. They experience a lack of transparency that encourages teams to hoard test infrastructure, and they create the possibility of a “dark budget” that departments can drive entire projects through without being accountable.

If you are attempting to reduce your overall test environment management costs, one of the first steps should be auditing your test environments and finding out which ones aren’t used. You may be surprised to find that your organization is holding onto test environments used to qualify long-retired software systems. Or, you may be surprised to find testing environments that have been repurposed by teams for uses far outside the scope of software testing.

Put simply, one of the most effective ways to keep test environment costs down is to identify wasteful environments and reclaim them using Plutora.

The post Control Costs: Keep Track of Test Environments appeared first on Plutora.

Read the original blog entry...

More Stories By Plutora Blog

Plutora provides Enterprise Release and Test Environment Management SaaS solutions aligning process, technology, and information to solve release orchestration challenges for the enterprise.

Plutora’s SaaS solution enables organizations to model release management and test environment management activities as a bridge between agile project teams and an enterprise’s ITSM initiatives. Using Plutora, you can orchestrate parallel releases from several independent DevOps groups all while giving your executives as well as change management specialists insight into overall risk.

Supporting the largest releases for the largest organizations throughout North America, EMEA, and Asia Pacific, Plutora provides proof that large companies can adopt DevOps while managing the risks that come with wider adoption of self-service and agile software development in the enterprise. Aligning process, technology, and information to solve increasingly complex release orchestration challenges, this Gartner “Cool Vendor in IT DevOps” upgrades the enterprise release management from spreadsheets, meetings, and email to an integrated dashboard giving release managers insight and control over large software releases.

Latest Stories
Real IoT production deployments running at scale are collecting sensor data from hundreds / thousands / millions of devices. The goal is to take business-critical actions on the real-time data and find insights from stored datasets. In his session at @ThingsExpo, John Walicki, Watson IoT Developer Advocate at IBM Cloud, will provide a fast-paced developer journey that follows the IoT sensor data from generation, to edge gateway, to edge analytics, to encryption, to the IBM Bluemix cloud, to Wa...
What is the best strategy for selecting the right offshore company for your business? In his session at 21st Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, will discuss the things to look for - positive and negative - in evaluating your options. He will also discuss how to maximize productivity with your offshore developers. Before you start your search, clearly understand your business needs and how that impacts software choices.
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
Most of the time there is a lot of work involved to move to the cloud, and most of that isn't really related to AWS or Azure or Google Cloud. Before we talk about public cloud vendors and DevOps tools, there are usually several technical and non-technical challenges that are connected to it and that every company needs to solve to move to the cloud. In his session at 21st Cloud Expo, Stefano Bellasio, CEO and founder of Cloud Academy Inc., will discuss what the tools, disciplines, and cultural...
SYS-CON Events announced today that Fusic will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Fusic Co. provides mocks as virtual IoT devices. You can customize mocks, and get any amount of data at any time in your test. For more information, visit https://fusic.co.jp/english/.
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
With the rise of DevOps, containers are at the brink of becoming a pervasive technology in Enterprise IT to accelerate application delivery for the business. When it comes to adopting containers in the enterprise, security is the highest adoption barrier. Is your organization ready to address the security risks with containers for your DevOps environment? In his session at @DevOpsSummit at 21st Cloud Expo, Chris Van Tuin, Chief Technologist, NA West at Red Hat, will discuss: The top security r...
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
IBM helps FinTechs and financial services companies build and monetize cognitive-enabled financial services apps quickly and at scale. Hosted on IBM Bluemix, IBM’s platform builds in customer insights, regulatory compliance analytics and security to help reduce development time and testing. In his session at 21st Cloud Expo, Lennart Frantzell, a Developer Advocate with IBM, will discuss how these tools simplify the time-consuming tasks of selection, mapping and data integration, allowing devel...
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
There is huge complexity in implementing a successful digital business that requires efficient on-premise and cloud back-end infrastructure, IT and Internet of Things (IoT) data, analytics, Machine Learning, Artificial Intelligence (AI) and Digital Applications. In the data center alone, there are physical and virtual infrastructures, multiple operating systems, multiple applications and new and emerging business and technological paradigms such as cloud computing and XaaS. And then there are pe...
Today traditional IT approaches leverage well-architected compute/networking domains to control what applications can access what data, and how. DevOps includes rapid application development/deployment leveraging concepts like containerization, third-party sourced applications and databases. Such applications need access to production data for its test and iteration cycles. Data Security? That sounds like a roadblock to DevOps vs. protecting the crown jewels to those in IT.
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...