Opsera, a Unified DevOps platform provider, has announced a new “Leadership Dashboard” capability within its Unified Insights product. The dashboard is designed to provide engineering leaders with detailed visibility into development workflows, developer productivity, and the impact of AI-powered tools, particularly focusing on GitHub Copilot.
Measuring the impact of AI tools in DevOps
The new dashboard addresses the growing need for organizations to measure the adoption, impact, and return on investment (ROI) of AI-assisted development tools. Opsera’s recent analysis of GitHub Copilot adoption highlighted several key trends:
- Time savings: An 8.69% increase in pull requests (PRs) and a 15% increase in the pull request merge rate were observed.
- Productivity gains: Productivity gains of 15-20% were reported, although this varied depending on industry, team size, experience, and team maturity.
- Code quality: Developers accepted 31% of Copilot’s suggestions, with 20-25% of those suggestions remaining in the final codebase after edits and reviews.
Opsera Unified Insights, powered by the company’s Hummingbird AI, aims to provide a comprehensive view of these metrics, along with data on code acceptance rates and developer satisfaction. This allows leaders to make data-driven decisions to maximize the benefits of AI-assisted development.
AI drives demand for high-paying tech jobs, finds iCIMS report
The Leadership Dashboard integrates insights from both the “inner loop” (individual developer coding process) and the “outer loop” (broader DevOps workflows, including CI/CD pipelines, DORA metrics, security reviews, and deployment). This holistic view is intended to help engineering leaders balance speed and quality while optimizing resources. Key metrics tracked by the dashboard include:
- Inner-loop activities: Copilot impact and value, planning, velocity, technical debt, and developer experience (DevEx).
- Outer-loop activities: Throughput, stability, reliability, pipeline metrics, security, quality posture, and DORA metrics (Deployment Frequency, Average Time to Pull Request, Change Failure Rate, Mean Time to Restore). Specifically:
- Deployment Frequency: Aiming for greater than one deployment per day.
- Average Time to Pull Request (PR): Aiming for less than one business day.
- Change Failure Rate: Aiming for 15% or less.
- MTTR (Mean Time to Restore): Aiming for less than one hour.
Opsera’s CEO, Kumar Chivukula, emphasizes that the new capabilities are designed to connect data points between software development and software delivery activities, providing actionable insights through Hummingbird AI.