> ## Content Index
> Fetch the complete content index at: https://softwaretestingweekly.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Issue #80
- URL: https://softwaretestingweekly.com/issues/80/
- Published: 2021-07-16T22:45:58.000Z
- Updated: 2026-06-10T13:17:36.000Z
- Description: 2021 State of Testing in DevOps
- Author: Dawid Dylowicz

| Comment                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
| -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Welcome to the **80th** issue!This week, I found two recently-published reports on the state of testing that I'd like to share with you:[2021 State of Testing in DevOps](https://engage.mabl.com/rs/069-VDB-236/images/2021-State-of-Testing-in-DevOps-Benchmark-Report.pdf?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) by [Mabl](https://www.mabl.com/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) — including lots of DevOps-related insights regarding CI/CD and tools, but also the changing role of QA in such environment.[Test Coverage Guide for Mobile and Web Apps](https://www.perfecto.io/sites/perfecto/files/pdfs/perfecto-test-coveragee-index-magazine-ed13.pdf?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) by [Perfecto](https://www.perfecto.io/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) — including up-to-date usage distribution of mobile devices, browsers, and operating systems grouped by country.Hope you'll enjoy the reads and learn something new, as I did.Happy testing!*[Dawid Dylowicz](https://linkedin.com/in/dawid-dylowicz/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)* |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| Sponsored [Introducing Playwright's New Test Runner](https://applitools.info/9fl?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Playwright Test is a new test runner built specifically to accommodate end-to-end testing needs. Join Principal Engineer, Andrey Lushinkov on July 29th to learn how to author new tests, migrate existing tests, and deploy them on CI. [Save your seat now](https://applitools.info/9fl?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80).[applitools.info](https://applitools.info/9fl?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| NEWS                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| [Focus on Goals over Risks](https://jlottosen.wordpress.com/2021/07/09/focus-on-goals-over-risks/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Why focusing on risks might not be the best option? [Jesper Ottosen](https://www.linkedin.com/in/jlottosen/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) shows an interesting perspective of focusing on goals instead and what benefits they can bring.[jlottosen.wordpress.com](https://jlottosen.wordpress.com/2021/07/09/focus-on-goals-over-risks/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| [Leadership in Test: Service Testing](https://theqalead.com/topics/service-testing/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Here's an interesting read from [Paul Gerrard](https://www.linkedin.com/in/paulgerrard/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) who puts some light on three important parts of service testing, such as performance, reliability and manageability.[theqalead.com](https://theqalead.com/topics/service-testing/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
| [Quality Shopper, Stop Lookin’ At What You Can’t Buy](https://qeunit.com/blog/quality-shopper-stop-lookin-at-what-you-cant-buy/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)[Antoine Craske](https://www.linkedin.com/in/acraske/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) shares a good reminder that quality cannot be bought with new fancy tools or test frameworks — it has to be developed.[qeunit.com](https://qeunit.com/blog/quality-shopper-stop-lookin-at-what-you-cant-buy/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| [What is the right question to ask?](https://www.eviltester.com/blog/eviltester/2021/07/do-we-need-to-test-at-all/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Questions are one of the most powerful tools that a tester can have. [Alan Richardson](https://www.linkedin.com/in/eviltester/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) provides some examples and tips on which ones to ask and when.And here's a good complementary read from [Ravisuriya Eswara](https://www.linkedin.com/in/ravisuriya/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) on [Assumptions are Essentials and Necessity](https://testinggarage.blogspot.com/2021/07/assumptions-are-essentials-and-necessity-software-testing-and-automation-engineering-heuristics-models-test-data-ravisuriya.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80).[eviltester.com](https://www.eviltester.com/blog/eviltester/2021/07/do-we-need-to-test-at-all/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                          |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| AUTOMATION                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
| [Parallelizing test automation? Read this first.](https://responsibleautomation.wordpress.com/2021/07/08/parallelizing-test-automation-read-this-first/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Parallelisation seems like a simple way of improving the test execution speed, right? Well, not so fast. [Paul Grizzaffi](https://www.linkedin.com/in/paulgrizzaffi/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) warns about the challenges you might face during implementation.[responsibleautomation.wordpress.com](https://responsibleautomation.wordpress.com/2021/07/08/parallelizing-test-automation-read-this-first/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| [Serverless integration testing with CDK — Part 3](https://www.10printiamcool.com/serverless-integration-testing-with-cdk-part-3?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Wondering how to do serverless testing? This is yet another great article by [Andy Blackledge](https://www.linkedin.com/in/andy-blackledge/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) that is a continuation of the previous two articles that I featured [two weeks ago](https://softwaretestingweekly.com/issues/78?m=web&utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80#xC8CtEz). This time, it's about simplifying the test stack.[10printiamcool.com](https://www.10printiamcool.com/serverless-integration-testing-with-cdk-part-3?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                   |
| [Should You Use Contract Testing?](https://alexromanov.github.io/2021/07/12/should-you-use-contract-testing/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)[Oleksandr Romanov](https://www.linkedin.com/in/oleksandr-romanov/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) found an interesting way of explaining contract testing from both the tester and developer perspectives, and explains when you should follow this practice.[alexromanov.github.io](https://alexromanov.github.io/2021/07/12/should-you-use-contract-testing/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| [Testing A Web App Using The Keyboard Only](https://glebbahmutov.com/blog/test-app-using-the-keyboard/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Navigating through the webpage using only a keyboard is one of the fundamental accessibility tests. But can you automate it? [Gleb Bahmutov](https://www.linkedin.com/in/bahmutov/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) proves so by implementing a keyboard-driven test in Cypress. Well done![glebbahmutov.com](https://glebbahmutov.com/blog/test-app-using-the-keyboard/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
| [The definitive guide of Android UI Automator with Kotlin](https://proandroiddev.com/the-definitive-guide-of-android-ui-automator-with-kotlin-2eab40edab0d?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)This is the kind of debut blog article that I appreciate! [Heitor Paceli](https://www.linkedin.com/in/heitorpaceli/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) shared a comprehensive guide to getting started with UI test automation on Android in Kotlin, including plenty of code examples.Additionally, [Saif Siddiqui](https://www.linkedin.com/in/saifsms91/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) created a short, handy video explaining how to use [The UiAutomator2 Driver for Android](https://mobiletestingtip.blogspot.com/2021/07/android-uiautomator2-finding-elements.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80).[proandroiddev.com](https://proandroiddev.com/the-definitive-guide-of-android-ui-automator-with-kotlin-2eab40edab0d?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                               |
| [UI Testing Best Practices](https://medium.com/glassdoor-engineering/ui-testing-best-practices-ccf33d2597a2?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Here's a handful of best practices for UI testing that [Bryce Dorn](https://www.linkedin.com/in/brycedorn/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) and his colleagues came up with. And they all look valid to me.[medium.com](https://medium.com/glassdoor-engineering/ui-testing-best-practices-ccf33d2597a2?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| TOOLS                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| [Gatling and the test data generator pattern](http://bestofthetest.blogspot.com/2021/07/gatling-and-test-data-generator-pattern.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)Data generation is one of the key aspects of load testing and [Matthew Bretten](https://www.linkedin.com/in/matthewbretten/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) demonstrates a great way of doing it in [Gatling](https://gatling.io/open-source/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) tests.[bestofthetest.blogspot.com](http://bestofthetest.blogspot.com/2021/07/gatling-and-test-data-generator-pattern.html?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
| [How to do performance testing using the k6 tool?](https://tsh.io/blog/how-to-do-performance-testing-using-k6/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)This is a massive guide by [Marcin Basiakowski](https://www.linkedin.com/in/marcin-basiakowski/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) to getting started with performance testing using the open-source [k6](https://k6.io/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) tool.And here's an equally good tutorial about [Load Testing SQL Databases with k6](https://k6.io/blog/load-testing-sql-databases-with-k6/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) by [Wai Foong Ng](https://www.linkedin.com/in/wai-foong-ng-694619185/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80).[tsh.io](https://tsh.io/blog/how-to-do-performance-testing-using-k6/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                    |
| [Selenium Test Automation Template](https://thirddriver.medium.com/selenium-test-automation-template-82c322a83bad?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)If you're looking for a project template to start writing tests in Java, check out this one by [Madhawa Ratnayake](https://www.linkedin.com/in/madhawar/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80). It's uses [TestNG](https://testng.org/doc/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) test runner for [Selenium](https://www.selenium.dev/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) and implements the Page Object pattern.[thirddriver.medium.com](https://thirddriver.medium.com/selenium-test-automation-template-82c322a83bad?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                                                                                                                                               |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| BOOKS                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| [The DevOps Handbook (Chapter 17\. Integrate Hypothesis-Driven Development and A/B Testing into Our Daily Work)](https://red-green-refactor.com/2021/07/10/book-club-the-devops-handbook-chapter-17-integrate-hypothesis-driven-development-and-a-b-testing-into-our-daily-work/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)[Thomas Haver](https://www.linkedin.com/in/thomas-haver/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) shares a short summary of [The DevOps Handbook](https://www.goodreads.com/book/show/26083308-the-devops-handbook?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)'s 17th chapter explaining the benefits of integrating A/B testing in the pipeline.[red-green-refactor.com](https://red-green-refactor.com/2021/07/10/book-club-the-devops-handbook-chapter-17-integrate-hypothesis-driven-development-and-a-b-testing-into-our-daily-work/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)                                                                                                                                                                                                                                             |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| And…                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| [The best playlist for coding...](https://www.reddit.com/r/ProgrammerHumor/comments/okcijl/spotifyc/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80) 😂                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| Thanks for reading!If you like this newsletter and it helps you become a better tester, you can say thanks and [buy me a coffee](https://buymeacoffee.com/softwaretestingweekly?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80).*[Dawid Dylowicz](https://linkedin.com/in/dawid-dylowicz/?utm%5Fcampaign=Software%2BTesting%2BWeekly&utm%5Fsource=Software%5FTesting%5FWeekly%5F80)*                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |