There are innumerable DevOps and Agile success stories around. Whether it is a start-up, digital natives or traditional IT Service organization, many have gained experience at least with Agile, but there are instances where DevOps is an uncharted giant. However, an organization had overcome this challenge in last few years and built on the capability and experience to implement Agile for their clients. Many organizations developed DevOps and Agile in a Box, which would allow customers to test, deploy and implement applications in a controlled environment before stepping onto on a large scale transformation. DevOps and Agile in a Box are ready to solve a real-world business problem. But does anyone know that right DevOps practices are being followed, or DevOps actually brings in the benefit, do the organization measure and monitor DevOps?
While there are many different tools and approaches to DevOps, it is an accepted fact that it is extremely important to gain experience than to get the tools right the first time around. As a result, many organizations have developed a full set of processes, tools and underlying architecture to get started and rapidly progress to actually delivering value.
With so many organization implementing Agile and DevOps, experts across the industry have conducted 100+ workshops on DevOps to understand the common challenge areas – and the top three challenges are No DevOps metrics, No DevOps Centre of Excellence and Planning in a DevOps environment. Though there are multiple success stories establishing the fact of DevOps plus Agile, there is multitude of instances where the majority of the organization’s struggle with the latest transformation journey. This may be due to a number of reasons:
- As an organization, one is not sure where to start from and what is most suitable – what tools should one use, what DevOps practices to follow
- There are too many unknowns, difficult to develop a business case
- Too many discussions, planning sessions and technical directions, no one actually focuses on the real-time business problem
- Leadership is afraid of the investments required, no clarity on the areas of investment
- Lack of DevOps training and capability
- Last, not the least, difficult to change people culture, very difficult to shift from existing working behavior to the DevOps style of delivery. Everyone thinks that they are not ready.
Though Agile methodology has its own metrics but measuring DevOps or its success is still a dark cloud. But what should we measure – is it the User Experience, Productivity, Efficiency or the Software/Product Quality. The organization should have the goals defined linking together software quality, the speed of delivery, customer experience, business success and definitely client satisfaction. The below table details some:
Depending on the industry, domain, software being implemented, one may not focus on all the areas but can measure specific metrics. For e.g. a retail online shopping website checks on application performance, but an online railway ticket booking system will focus more on the speed or application response time, an airline booking and luggage check-in app will stress more on the user experience, etc.