> ## Content Index > Fetch the complete content index at: https://softwaretestingweekly.com/llms.txt > Use this file to discover other available public pages before exploring further. # Issue #224 - URL: https://softwaretestingweekly.com/issues/224/ - Published: 2024-06-17T07:00:00.000Z - Updated: 2026-06-10T13:18:43.000Z - Description: Flaky Tests Overhaul at Uber 🏎️ - Author: Dawid Dylowicz | Comment | | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Welcome to the **224th** issue!Are your tests flaky? You're not alone.It's a common problem, especially when you implement tests at scale.Take Uber, for example. They have over \~\~600,000\~\~ 950,000 tests!And here's a wonderful overview of [Flaky Tests Overhaul at Uber](https://www.uber.com/blog/flaky-tests-overhaul/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).But there's more advice:[A Few Thoughts On Flaky Tests](https://playwrightsolutions.com/a-few-thoughts-on-flakey-tests-playwright-solutions/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)[Are Your Automated UI Tests Unreliable? How to Keep Them Reliable](https://qaexpertise.com/blog/are-your-automated-ui-tests-unreliable-how-to-keep-them-reliable/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)And finally, you can find more helpful resources by simply searching for ["flaky"](https://softwaretestingweekly.com/search?q=flaky&utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) in this newsletter's archive.Thanks [Xiaoyang Tan](https://www.linkedin.com/in/xytan01/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224), [Yushan Lin](https://www.linkedin.com/in/yushan-lin/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224), [Sergey Balabanov](https://www.linkedin.com/in/sergeybalabanov/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224), [Butch Mayhew](https://www.linkedin.com/in/butchmayhew/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) and [Priyanshu Shekhar](https://www.linkedin.com/in/pshekhar-qa/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) for sharing such great insights.\~\~Flaky\~\~ Happy testing! 🙂*[Dawid Dylowicz](https://linkedin.com/in/dawid-dylowicz/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)* | | | | Sponsored [Avoid Simple Email Errors That Could Violate GDPR](https://blog.mailsac.com/how-you-can-avoid-cc-errors-that-could-violate-gdpr/?utm%5Fmedium=email&utm%5Fsource=software%20testing%20weekly&utm%5Fcampaign=summer%20engagement&utm%5Fcontent=how%20to%20video)Protect your company's reputation from costly email mistakes. Explore [our guide](https://blog.mailsac.com/how-you-can-avoid-cc-errors-that-could-violate-gdpr/?utm%5Fmedium=email&utm%5Fsource=software%20testing%20weekly&utm%5Fcampaign=summer%20engagement&utm%5Fcontent=how%20to%20video) on programmatically ensuring emails are sent exactly as intended and only to the right recipients. Secure your company communications from the source.[blog.mailsac.com](https://blog.mailsac.com/how-you-can-avoid-cc-errors-that-could-violate-gdpr/?utm%5Fmedium=email&utm%5Fsource=software%20testing%20weekly&utm%5Fcampaign=summer%20engagement&utm%5Fcontent=how%20to%20video) | | | | NEWS | | [Getting to know Exploratory Testing](https://medium.com/@rt.chompoonuch/et-01-getting-to-know-exploratory-testing-a65b1cfaed1a?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)If you want to learn about exploratory testing, [Chompoonuch Rassameeamornrat](https://www.linkedin.com/in/rtchompooonuch/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) wrote a fantastic overview with lots of references to trusted sources on this topic.Moreover, [Gil Zilberfeld](https://www.linkedin.com/in/gilzilberfeld/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) explains why [Testing = Exploration + Checking](https://www.everydayunittesting.com/2024/06/testing-exploration-checking.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[medium.com](https://medium.com/@rt.chompoonuch/et-01-getting-to-know-exploratory-testing-a65b1cfaed1a?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [How to Foster a Culture of Quality in Practice?](https://medium.com/@karlamieses.km/bla-bla-bla-lots-of-qa-talk-and-vague-implementations-how-to-foster-a-culture-of-quality-in-real-f4db9e9a4315?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)It's a great question, and while setting quality culture is not an easy task, [Karla Mieses](https://www.linkedin.com/in/karla-mieses-1047b7122/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) gives a few tips on how to make it work.Similarly, [R M Dhananjay](https://www.linkedin.com/in/r-m-dhananjay-1451b0178/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) shares [My thoughts on the most important QA practices to follow for QAs starting their career](https://medium.com/@dhananjay.rm/my-thoughts-on-the-most-important-qa-practices-to-follow-for-qas-starting-their-career-30a8ba069909?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[medium.com](https://medium.com/@karlamieses.km/bla-bla-bla-lots-of-qa-talk-and-vague-implementations-how-to-foster-a-culture-of-quality-in-real-f4db9e9a4315?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Murphy's Law is a tester's best friend](https://theqacorner.medium.com/murphys-law-is-a-tester-s-best-friend-05513d9839de?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)*"Anything that can go wrong will go wrong."* — [Murphy's law](https://en.wikipedia.org/wiki/Murphy%27s%5Flaw?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224). And here's what we, testers, can learn from it.Additionally, [James Thomas](https://www.linkedin.com/in/james-thomas-840aa11a/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) points out that it's not possible to test everything all the time in an interesting article titled [Software Sisyphus](https://qahiccupps.blogspot.com/2024/06/software-sisyphus.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[theqacorner.medium.com](https://theqacorner.medium.com/murphys-law-is-a-tester-s-best-friend-05513d9839de?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [My learning experience for CTFL — after scoring it at 90%](https://alanliew.medium.com/my-learning-experience-for-ctfl-after-scoring-it-at-90-920881723d6e?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)There are a lot of opinions on whether it's worth doing QA certification. I liked this honest one by [Alan Liew](https://www.linkedin.com/in/alan-liew/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) on ISTQB-CTFL.[alanliew.medium.com](https://alanliew.medium.com/my-learning-experience-for-ctfl-after-scoring-it-at-90-920881723d6e?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Risks of being a QA](https://www.reddit.com/r/softwaretesting/comments/1d9o5y1/risks%5Fof%5Fbeing%5Fa%5Fqa/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)In this popular Reddit thread, many people shared what they think about the biggest risks of being a tester.I also found two other interesting discussions:[Will the demand for testers decrease in the future?](https://www.reddit.com/r/softwaretesting/comments/1dayhax/will%5Fthe%5Fdemand%5Ffor%5Ftester%5Fdecrease%5Fin%5Fthe%5Ffuture/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)[Does QA Engineering have a future?](https://www.reddit.com/r/QualityAssurance/comments/1dbfwde/does%5Fqa%5Fengineering%5Fhave%5Fa%5Ffuture/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)[reddit.com](https://www.reddit.com/r/softwaretesting/comments/1d9o5y1/risks%5Fof%5Fbeing%5Fa%5Fqa/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | | | AUTOMATION | | [Avoid wasting CI resources with selective testing and pre-commit hook on iOS](https://antran.app/2024/ios%5Fselective%5Ftesting/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)If you're testing iOS apps, you might be interested in [An Tran](https://www.linkedin.com/in/antranapp/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) approach to selecting and running only a subset of tests, depending on what part of the app changed.Similarly, [Atakan Karslı](https://www.linkedin.com/in/atakankarsli/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) shows how to achieve [Selective Unit Testing on iOS: Achieve 80% Faster Feedback](https://medium.com/trendyol-tech/selective-unit-testing-on-ios-achieve-80-faster-feedback-42e865c8ce20?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[antran.app](https://antran.app/2024/ios%5Fselective%5Ftesting/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Choosing the Right Test Automation Framework](https://ryancraventech.substack.com/p/choosing-the-right-test-automation?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)Whichever language and platform you work with, there are usually a lot of dedicated test tools and frameworks to choose from. [Ryan Craven](https://www.linkedin.com/in/ryanmcraven/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) wrote a general guide on what to consider when faced with such a choice.[ryancraventech.substack.com](https://ryancraventech.substack.com/p/choosing-the-right-test-automation?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Managing failed Selenium tests. Retrieve console logs and screenshots](https://medium.com/spin-technology-blog/managing-failed-tests-retrieve-console-logs-and-screenshots-8d59d5e64dfa?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)Using [Selenium](https://www.selenium.dev/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) in Java? [Roman Strokach](https://www.linkedin.com/in/roman-strokach-259766138/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) shows how to build an error reporting and logging solution into your test framework.[medium.com](https://medium.com/spin-technology-blog/managing-failed-tests-retrieve-console-logs-and-screenshots-8d59d5e64dfa?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [The Hidden Benefits of Unit Testing](https://javascript.plainenglish.io/the-hidden-benefits-of-unit-testing-a2f9eb42a8ea?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)I know that testers usually don't write unit tests but it's an important part of the overall test strategy. So if you'd like to understand why it's worth doing, here are some insights from [Francesco Borzì](https://www.linkedin.com/in/francesco-borzi/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[javascript.plainenglish.io](https://javascript.plainenglish.io/the-hidden-benefits-of-unit-testing-a2f9eb42a8ea?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Uploading a file to S3 — Integration test](https://isabeliita90.hashnode.dev/uploading-a-file-to-s3-integration-test?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)Do you need to do integration tests with AWS? [Isabel Garrido Cardenas](https://www.linkedin.com/in/isabel-garrido-cardenas/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) uses an example to show how to achieve that.[isabeliita90.hashnode.dev](https://isabeliita90.hashnode.dev/uploading-a-file-to-s3-integration-test?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | | | Sponsored [Gravity: Identify gaps in test coverage and prioritize test cases using AI](https://www.smartesting.com/en/gravity/?utm%5Fsource=software-testing-weekly&utm%5Fmedium=inserted-url&utm%5Fcampaign=newsletter-14-06-24)[Gravity](https://www.smartesting.com/en/gravity/?utm%5Fsource=software-testing-weekly&utm%5Fmedium=inserted-url&utm%5Fcampaign=newsletter-14-06-24) monitors real-world user behaviors and usage patterns in live production and test environments to generate quality analytics, identify test coverage gaps, and assist in prioritizing and generating test cases for tools like Cypress, Playwright, etc. Discover more: [book a demo](https://calendly.com/cristianocaetano/45min?utm%5Fsource=software-testing-weekly&utm%5Fmedium=inserted-url-demo&utm%5Fcampaign=newsletter-14-06-24) now. Stay tuned for the product launch in September![smartesting.com](https://www.smartesting.com/en/gravity/?utm%5Fsource=software-testing-weekly&utm%5Fmedium=inserted-url&utm%5Fcampaign=newsletter-14-06-24) | | | | TOOLS | | [It's Finally Here! A JSON Test Results Data Format](https://medium.com/@ma11hewthomas/its-finally-here-a-json-test-results-data-format-f485b77bbdbc?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)[Matthew Thomas](https://www.linkedin.com/in/ma11hewthomas/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) announces [CTRF](https://ctrf.io/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) — an open-source test reported in JSON format. It already supports popular test runners, such as Cypress, Jest, Playwright, and many more.[medium.com](https://medium.com/@ma11hewthomas/its-finally-here-a-json-test-results-data-format-f485b77bbdbc?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Supercharging Your Test Automation Code With AI Assistance In Your IDE](https://www.ministryoftesting.com/articles/supercharging-your-test-automation-code-with-ai-assistance-in-your-ide?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)If you want to know how AI can help you while coding automated tests in your IDE, [Valentin Agapitov](https://www.linkedin.com/in/valentin-agapitov/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) demonstrates a few examples.[ministryoftesting.com](https://www.ministryoftesting.com/articles/supercharging-your-test-automation-code-with-ai-assistance-in-your-ide?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | [Top Test Reporting Tools and a Comprehensive Comparison](https://medium.com/@bharatvarshney639/top-test-reporting-tools-and-a-comprehensive-comparison-6d62147907f2?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)[Bharat Varshney](https://www.linkedin.com/in/bharatvarshney/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) describes several popular test reporting tools for Java, JavaScript and other, more language-agnostic solutions.And if you want to see a practical example, [Meris Stupar](https://www.linkedin.com/in/meris-stupar-84610719a/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) shows how to set up [Allure Reporting for Playwright](https://medium.com/@merisstupar11/allure-reporting-and-playwright-quick-setup-powerful-insights-900a237a524d?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).[medium.com](https://medium.com/@bharatvarshney639/top-test-reporting-tools-and-a-comprehensive-comparison-6d62147907f2?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) | | | | VIDEOS | | [Contract Testing 101 with Marie Drake & Lewis Prescott](https://www.youtube.com/watch?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224&v=cw3z98ioIGY)Want to learn about contract testing? This one-hour overview by [Marie Cruz](https://www.linkedin.com/in/mariedesireecruz/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224), [Lewis Prescott](https://www.linkedin.com/in/lewis-prescott-12409a44/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) and [Nikolay Advolodkin](https://www.linkedin.com/in/nikolayadvolodkin/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) is a great way to start.[youtube.com](https://www.youtube.com/watch?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224&v=cw3z98ioIGY) | | [Current State of QA Job Market, Future Trends and AI - Part 1](https://www.youtube.com/watch?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224&v=PMHBYSXc4mE)[Evgeny Kim](https://www.linkedin.com/in/evgenykim1/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) and [Alex Khvastovich](https://www.linkedin.com/in/alexkhvastovich/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) had an interesting conversation about the condition of the QA market and trying to predict what's coming next, especially in the context of AI. Here you can watch the [second part](https://www.youtube.com/watch?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224&v=5p9d3Dm2QUc).[youtube.com](https://www.youtube.com/watch?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224&v=PMHBYSXc4mE) | | | | And… | | [Adding more E2E tests...](https://www.linkedin.com/feed/update/urn:li:activity:7206615185254469632/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224) 😂 | | | | Thanks for reading!If you like this newsletter and it helps you become a better tester — you can say thanks and [buy me a coffee](https://buymeacoffee.com/softwaretestingweekly?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224).*[Dawid Dylowicz](https://linkedin.com/in/dawid-dylowicz/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F224)* |