Test Flakiness — One of the main challenges of automated testing (Part II)
This is a great breakdown of possible test flakiness causes, supplemented by the triaging tips and potential fixes. By George Pirocanac from Google.
And you can also read the first part.
Welcome to the 224th issue!
Are your tests flaky? You're not alone.
It's a common problem, especially when you implement tests at scale.
Take Uber, for example. They have over 600,000 950,000 tests!
And here's a wonderful overview of Flaky Tests Overhaul at Uber.
But there's more advice:
And finally, you can find more helpful resources by simply searching for "flaky" in this newsletter's archive.
Thanks Xiaoyang Tan, Yushan Lin, Sergey Balabanov, Butch Mayhew and Priyanshu Shekhar for sharing such great insights.
Flaky Happy testing! 🙂
Health check for Test Automation: Blue green deployment
Sakshi Kakkar describes an interesting concept of having a temporary pipeline specifically for checking the new tests flakiness before moving them to the main pipeline.
9 Ways To Make Slow Tests Faster
Nothing is more annoying than slow and flaky tests. Tomas Fernandez gives comprehensive pieces of advice with examples on how to improve your test execution time.
You might not need to fix your flakey tests
Gregory Paciga shares an interesting opinion that sometimes you're better off getting rid of your flaky tests instead of fixing them.
5 Ways to Make Your End-To-End Tests More Stable
Test stability and lack of flakiness are some of the most desired outcomes of test automation. Dennis Martinez gives a few solid tips on achieving that.
How to Create Automated Atomic Tests in Automation
Small, independent tests are key to reducing flakiness and improving the test execution speed. Nikolay Advolodkin explains how to achieve it with Cypress in this 26-minute tutorial.
Best Practices For Creating Stable Selectors
When automating tests for web apps, you may run into problems with the flaky selectors. Luis Osvaldo Serna Gomez explains the common pitfalls and suggests possible solutions.
Less But Better: The Art of Writing Effective Test Suites
Shubham Sharma gives some good advice on improving test automation design and execution with good practices.
Additionally, Tobias Verhoog shares insights on Finding, Fixing and Preventing Flaky Tests.
