When the build is green, the product is of sufficient quality to release
Mirek Długosz warns about the risk of relying on a single metric to decide on release readiness and advises on how to improve this process.
Additionally, José Carréra wrote a great article about: Are You Seeing RED? Restoring Reliability To Test Results.
Whole-team approach to quality is one of the main agile testing principles. Ryan Craven shares his experience of joining a team with that mindset and what impact it had.
On top of that, you might be interested in implementing some Metrics for Testing — Guide to Quality Assurance as Aroni Das explains.
What are some ways to make Selenium faster?
Test execution speed is one of the most watched metrics in test automation projects. Someone on Reddit is wondering how you can speed up Selenium tests and the community provided some suggestions.
Furthermore, Kavitha Rajagopal explains: Is Selenium tool relevant in 2022?.
Testing Center of Excellence Clarified
You might have heard of the Testing Center of Excellence framework for introducing testing standards across the organisation. Zhimin Zhan shares his opinion on it in the context of test automation.
In relation to that, Dilruba Malik wrote about Uplifting QA Teams Through Metrics.
Note: If you can't access the full article, simply open it in a private tab.
Ryan Craven describes the common metrics for measuring test automation coverage, explaining its pros and cons and why it depends on different contexts.
And once you start improving your coverage, beware of the Flakey UI automation.
Note: If you can't access the full article, simply open it in a private tab.
The biggest-ever global outage: lessons for software engineers
In the previous issues, I've shared testers' opinions on the CrowdStrike outage. And today, I'd also like to highlight this amazing overview by Gergely Orosz.
Moreover, Geoff Cooney shares A Quality Metrics View of the CrowdStrike Outage based on mabl's data.
And finally, CrowdStrike has just released The Final Root Cause Analysis, explaining all the technical details.
Breaking the Test Case Addiction (Part 11)
Consider thinking in terms of testing, rather than test cases. And if you are applying test cases, please don’t count them. And if you count them, please don’t believe that the count means anything.
In another brilliant post of the series, Michael Bolton continues to explain why the number of test cases is not a good metric for measuring quality.
Hungry for more? There's already the next part on why it's so hard to tell when testing will be done.
Welcome to the 171st issue!
Since the beginning of this newsletter, I've featured well over 4,000 articles and other resources on software testing.
And they're all stored online.
So if you want to learn more about a particular topic you're interested in, simply use the Search function.
For example, here are the results for metrics, Playwright or test strategy.
Hope that helps you discover even more great news.
Happy testing! 🙂
"Bug counts are a measurement of nothing else than how many bugs your team are reporting; code coverage only tells you how much of your code is completely untested or unreachable; and test pass rates…are mostly useless."
I enjoyed Alan Page's take on the common problems with metrics and his advice on how to approach it right. A recommended read for your testing team.
DO YOU NEED TO CERTIFY YOUR GOOGLE TESTS?
Introducing Cantata Hybrid, the world's first certification solution for Google tests! Cantata Hybrid generates certified test results, including code coverage metrics up to MC/DC, from your existing GoogleTest® and GoogleMock® suites, without needing to modify them on your host/target platform or learn a new tool. Avoid the risk, delay and expense of certifying GoogleTest® yourself, or migrating your tests to a certified tool. Try it for FREE today.
