Measuring QA Success: Beyond Test Counts and Bug Reports
What quality metrics are worth measuring? Probably not the ones that you may think of, as Joshua Bihun points out.
Moreover, George Ukkuru concisely points out Why "Zero Bugs" Is the Wrong Goal in QA.
AI and Testing: Using Local Models for Testing
Jeff Nyman continues a detailed series of articles on AI in testing, and shows how to set up and run a model on your machine to create automated tests with evaluation metrics. You can also read a follow-up article about Using Model Pipelines for Testing.
The Death of Determinism: How AI Forces Us to Rethink Testing
Padget Avery explains how testing AI differs from the traditional approach, requiring moving from strict assertions to thresholds, metrics, and human review in pipelines.
Moreover, Katja Obring shares thoughts on What I don't understand about AI evals (yet) and how The AI evals field chose a flawed tool and stuck with it.
Build a Test Metrics Dashboard with Elasticsearch and Kibana
If you're looking for a way to track the results of your test automation tests over time, Oleksii Shamrai wrote a detailed guide to setting up a dashboard in Kibana.
This is a great, thought-provoking article by Vernon Richards about why DORA metrics might not be perfect and an alternative approach to metrics.
Furthermore, Veronika Moran shares how they implemented QA metrics from scratch and Abhishek Verma gives practical advice on How I Use Data Analytics to Find Gaps in Test Coverage.
Beyond MTTR: 7 incident metrics that matter and 3 that don't
Have you heard of the DORA metrics? In this article, Ashley Sawatsky goes a step further describing several other metrics and explaining why to use them.
What's more, Rahul Parwal wrote about Testing & Quality Metrics — Pitfalls to Avoid.
Keeping tests valuable: Are the code coverage metrics reliable?
"When a metric becomes a goal, it stops being a good metric." — Goodhart's law.
Rafael Miguel explains how to use metrics, such as code coverage, right.
Software Quality: From metrics to habits
In this insightful article, Flavien Huynh suggests setting up quality metrics for teams on five levels and links to other articles that give more context to each level.
On top of that, Antoine Craske gives an overview of the 5 New Metrics For Quality at Speed Test Automation.
Engineering Metrics: 12 Pitfalls
Engineering metrics are great but only if done right. Here are the common pitfalls that Mojtaba Hosseini has seen in his career.
A good follow-up read to that is A View of Metrics and Measurement by Jay Trommer.
Testing Metrics: Are You Really Sure about the Quality of Your Product?
There's a lot to learn from this comprehensive overview of various software testing metrics by Andrey Ostapenko where he describes what type of metrics can be used and how they can be measured using various formulas and analytics.
