An Introductory Guide to Web Performance Testing
Marie Cruz wrote a detailed guide on web performance testing, including examples of metrics to measure and helpful tools to use.
"Bug counts are a measurement of nothing else than how many bugs your team are reporting; code coverage only tells you how much of your code is completely untested or unreachable; and test pass rates…are mostly useless."
I enjoyed Alan Page's take on the common problems with metrics and his advice on how to approach it right. A recommended read for your testing team.
Welcome to the 268th issue!
Quality is hard to measure.
But the activities impacting quality can be measured, such as development practices, technical debt or test coverage.
That's where QE Score comes in.
Simon Champenois created it to pragmatically collect and track metrics in one place.
To learn more, check out Simon's article about Quality Engineering, Quantified: What Your QE Score Really Means.
Happy testing! 🙂
How can I trust my test suite?
Great question! Antonello D'Ippolito suggests using some metrics and indicators that can help you assess the confidence in your tests.
Also, Paul Grizzaffi wrote about Asserting Them Softly — Soft Asserts In Practice, explaining how it can help you better understand the failing tests in a test suite.
Use Playwright tests to monitor your apps with Checkly!
Checkly lets you easily deploy high-quality Playwright scripts to monitor Apps, Websites & APIs, from Dev to Production. Validate crucial user flows, collect error traces, screenshots and performance metrics, and understand how your app performs for users across the globe! Start for free!
Welcome to the 171st issue!
Since the beginning of this newsletter, I've featured well over 4,000 articles and other resources on software testing.
And they're all stored online.
So if you want to learn more about a particular topic you're interested in, simply use the Search function.
For example, here are the results for metrics, Playwright or test strategy.
Hope that helps you discover even more great news.
Happy testing! 🙂
Testmo: #1 Test Management — Fast, Modern & Fully-Featured
All your manual tests, exploratory sessions & test automation in one modern platform with Testmo. Enjoy testing with a lightning-fast UI, rich reporting & metrics, full integration with Jira, GitHub, GitLab, CI & more. Just 2 minutes to get started, try Testmo free.
Why test coverage targets backfire
Michael Küsters uses insightful examples to show why relying solely on test coverage metrics might not tell us the full story about the quality of our product.
When the build is green, the product is of sufficient quality to release
Mirek Długosz warns about the risk of relying on a single metric to decide on release readiness and advises on how to improve this process.
Additionally, José Carréra wrote a great article about: Are You Seeing RED? Restoring Reliability To Test Results.