Are Code Coverage Metrics Trustworthy?
I like how Rafael Miguel explained the reality of code coverage, suggesting what other testing practices bring the most value.
Metrics & data
Testing & Evaluating LLMs: Key Metrics and Best Practices
What does it take to test LLM-based apps? In a three-part series of articles, Sumit Soman shares the methods and tips to achieve it. You can read the Part 2 and Part 3.
Top 3 Useless Quality Metrics (And What to Measure Instead)
Daria Kotelenets makes several good points about the problem with common quality metrics, such as code coverage or the number of bugs. I must admit I've saved a few quotes from this article!
Continuous Integration Benchmark Metrics
How would you measure the robustness of your CI solution? Michael Küsters suggests six key metrics that can help you assess and improve the pipeline.
Engineering Metrics: 12 Pitfalls
Engineering metrics are great but only if done right. Here are the common pitfalls that Mojtaba Hosseini has seen in his career.
A good follow-up read to that is A View of Metrics and Measurement by Jay Trommer.
Over the past few weeks, Angela Riggs put together an insightful series of five articles about managing metrics, including some practical advice. You can read the following parts here: part 2, part 3, part 4 and part 5.
Michael Küsters advises on how to use a metrics system and warns against the common pitfalls.
Interested in some examples? Angela Riggs wrote a great overview of Service Level Metrics.
Having good metrics is often a key to improving the quality of your product and services. But they may also be misleading, as Martin Ivison explains.
