> ## Content Index
> Fetch the complete content index at: https://softwaretestingweekly.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Issue #335
- URL: https://softwaretestingweekly.com/issues/335/
- Published: 2026-11-15T17:41:55.000Z
- Updated: 2026-11-15T17:43:11.000Z
- Description: Building Agentic QA Harnesses 🛠️
- Author: Dawid Dylowicz

| Comment                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Welcome to the **335th** issue!More testers and engineers now build agentic QA harnesses. Naturally, this raises the question of whether AI can really replace us.For example, [Dejan Menges](https://www.linkedin.com/in/dejanmenges/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) described his approach: [The QA engineer on my laptop works nights](https://menges.dev/writing/qa-engineer-on-my-laptop-works-nights/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).Since he got lots of questions, he wrote a good follow-up: [We write more code than ever. Who checks it?](https://menges.dev/writing/future-of-qa-with-ai-agents/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)His conclusion?*"Agents don't replace QA. The harness around them is QA."*More on that below.Happy testing! 🙂*[Dawid Dylowicz](https://www.linkedin.com/in/dawid-dylowicz/?ref=softwaretestingweekly.com)*                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| Sponsored [Which QA Skills Still Matter as AI Takes Over the Routine Work?](https://www.browserstack.com/events/qa-leadership-summit-winter-2026?utm%5Fsource=newsletter&utm%5Fmedium=PR&utm%5Fplatform=&utm%5Fcontent=digitalevent&utm%5Fcampaign=Summit-18-Nov-2026-AI-QALS-Winter-2026-Edition&utm%5Fcampaigncode=701OW000012Iuq5YAC&utm%5Fterm=software-testing-weekly-qals-nov)Wondering which QA skills still matter as AI takes on more of the testing? On **18 November**, BrowserStack's QA Leadership Summit brings together speakers from Amazon, Microsoft, OneTrust and Pizza Hut to share what's changing in their teams. If you lead a team, there's a track on AI strategy and metrics. If you test every day, there are hands-on workshops on AI-assisted testing. It's free and virtual. [Register here!](https://www.browserstack.com/events/qa-leadership-summit-winter-2026?utm%5Fsource=newsletter&utm%5Fmedium=PR&utm%5Fplatform=&utm%5Fcontent=digitalevent&utm%5Fcampaign=Summit-18-Nov-2026-AI-QALS-Winter-2026-Edition&utm%5Fcampaigncode=701OW000012Iuq5YAC&utm%5Fterm=software-testing-weekly-qals-nov)[browserstack.com](https://www.browserstack.com/events/qa-leadership-summit-winter-2026?utm%5Fsource=newsletter&utm%5Fmedium=PR&utm%5Fplatform=&utm%5Fcontent=digitalevent&utm%5Fcampaign=Summit-18-Nov-2026-AI-QALS-Winter-2026-Edition&utm%5Fcampaigncode=701OW000012Iuq5YAC&utm%5Fterm=software-testing-weekly-qals-nov)                                                                                                                                                                                                                     |
| [Reach **9,263** software testers with a sponsored link →](https://softwaretestingweekly.com/sponsorship)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| News                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| [We're Building AI to Replace Ourselves. What's cooking?](https://www.reddit.com/r/QualityAssurance/comments/1xpav5l/were%5Fbuilding%5Fai%5Fto%5Freplace%5Fourselves%5Fwhats/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)This Reddit discussion is a good follow-up to what I just mentioned in the Comment section above. It tells us what the testing community really thinks.Also related:[Why an Agentic Test Pipeline Can't Replace a Human QA](https://medium.com/womenintechnology/why-an-agentic-test-pipeline-cant-replace-a-human-qa-45e2b2ed2277?sk=bf39b6e3414a3ae1da1493f212127aae&utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) by [Josphine Job](https://www.linkedin.com/in/josphine-j-qalead/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[The Future of QA: AI, Automation, and Continuous Quality](https://juliapottinger.com/the-future-of-qa-ai-automation-continuous-quality/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) by [Julia Pottinger](https://www.linkedin.com/in/julia-pottinger/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[reddit.com](https://www.reddit.com/r/QualityAssurance/comments/1xpav5l/were%5Fbuilding%5Fai%5Fto%5Freplace%5Fourselves%5Fwhats/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                      |
| [How Much Does a Bug Cost at Each Stage? What's Actually Known, and What's Folklore](https://mykeralduxin.medium.com/how-much-does-a-bug-cost-at-each-stage-whats-actually-known-and-what-s-folklore-d266983778ed?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)Have you seen the chart that says a bug costs 100x more in production? Apparently, the study behind that chart doesn't exist and [Myke Ralduxin](https://www.linkedin.com/in/myke-ralduxin/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) suggests relying on your own incident data instead.Moreover, [Martin Ivison](https://www.linkedin.com/in/martin-ivison/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shares a wider view on why [Software isn't great, and that's getting locked in for years to come](https://testinggold.substack.com/p/software-isnt-great-and-thats-getting?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[mykeralduxin.medium.com](https://mykeralduxin.medium.com/how-much-does-a-bug-cost-at-each-stage-whats-actually-known-and-what-s-folklore-d266983778ed?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                              |
| [Self-reinforcing quality / adopting verification pattern](https://lethain.com/adopting-verification-pattern/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[Will Larson](https://www.linkedin.com/in/lethain/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) describes how their AI coding agents now write a verification file for each pull request. It lists what the agent checked and what it couldn't check, which shows where to improve the setup.Also, [Betty Lin](https://www.linkedin.com/in/betty-lin-120b47a/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) reminds us that [A Skill That Runs Is Not a Skill That Helps](https://medium.com/@betty.lin.twn/a-skill-that-runs-is-not-a-skill-that-helps-b7bb98fa3386?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[lethain.com](https://lethain.com/adopting-verification-pattern/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
| [Vibe Testing: When the Whole SDLC Runs on Feelings](https://medium.com/@wernerthiago/vibe-testing-when-the-whole-sdlc-runs-on-feelings-39ac80f75401?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[Thiago Werner](https://www.linkedin.com/in/wernerthiago/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) has a point on why AI won't speed up testing if no one checks the stories and code before.Also, a relevant Reddit thread: [How are teams keeping QA from falling behind now that devs use AI coding agents?](https://www.reddit.com/r/QualityAssurance/comments/1xqdvow/how%5Fare%5Fteams%5Fkeeping%5Fqa%5Ffrom%5Ffalling%5Fbehind%5Fnow/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335). It continues in [a sibling thread](https://www.reddit.com/r/softwaretesting/comments/1xqdyif/how%5Fare%5Fteams%5Fkeeping%5Fqa%5Ffrom%5Ffalling%5Fbehind%5Fnow/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/@wernerthiago/vibe-testing-when-the-whole-sdlc-runs-on-feelings-39ac80f75401?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                |
| [What an AI-Drafted API Test List Caught, and Missed, Compared with My Sandbox Findings](https://medium.com/@banututuncu/what-an-ai-drafted-api-test-list-caught-and-missed-compared-with-my-sandbox-findings-5b9117b08f18?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[Banu Tutuncu](https://www.linkedin.com/in/banututuncu/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) did a small experiment on how many of her manual findings an AI-drafted test list would catch. There's a difference.[medium.com](https://medium.com/@banututuncu/what-an-ai-drafted-api-test-list-caught-and-missed-compared-with-my-sandbox-findings-5b9117b08f18?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| Automation                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| [AI agents can write the code. They don't get to own the release.](https://medium.com/@aydenjlee/ai-agents-can-write-the-code-they-dont-get-to-own-the-release-66ac5dab581c?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)If you let AI agents write and merge code, make it clear which decisions are left to them and which you'll make yourself. [Ayden Lee](https://www.linkedin.com/in/aydenjlee/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) proposes the process.On that note, someone on Reddit asked: [How are you running test automation in 2026? Is anyone using AI agents?](https://www.reddit.com/r/QualityAssurance/comments/1xsrswh/title%5Fhow%5Fare%5Fyou%5Frunning%5Ftest%5Fautomation%5Fin%5F2026/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[medium.com](https://medium.com/@aydenjlee/ai-agents-can-write-the-code-they-dont-get-to-own-the-release-66ac5dab581c?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| [Cutting Test Cycles from Days to Hours: Lessons from Scaling Golden Tests at Bancolombia](https://medium.com/bancolombia-tech/cutting-test-cycles-from-days-to-hours-lessons-from-scaling-golden-tests-at-bancolombia-7f4c8a46a08e?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)I like to see how other companies approach testing problems. [Juan Diego Campuzano Osorio](https://www.linkedin.com/in/jcampuza2/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shares how a bank checks its Flutter screens against approved images in CI instead of in design meetings.Similarly, [Alex Ferrer](https://www.linkedin.com/in/alexferrerlopez/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) presents their story on [Automating Mobile Crash Triage at ManoMano](https://medium.com/manomano-tech/from-four-crashlytics-dashboards-to-one-slack-message-35b224071c8e?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/bancolombia-tech/cutting-test-cycles-from-days-to-hours-lessons-from-scaling-golden-tests-at-bancolombia-7f4c8a46a08e?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                  |
| [Load Testing Beyond 1,000 Users: Are We Testing the Right Workload?](https://medium.com/@sinha.deepak/load-testing-beyond-1-000-users-are-we-testing-the-right-workload-49de3cb43046?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[Deepak Sinha](https://www.linkedin.com/in/deepaksinhalogimindz/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) compares constant, ramp, staircase and spike load in [k6](https://k6.io/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) and explains why two tests with the same peak can end up sending very different amounts of traffic.Additionally, [Irfan Mujagić](https://www.linkedin.com/in/irfan-mujagi%C4%87-618435206/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) describes [How to Pick Concurrent Users for a Load Test](https://www.thegreenreport.blog/articles/registered-is-not-concurrent-how-to-pick-concurrent-users-for-a-load-test/registered-is-not-concurrent-how-to-pick-concurrent-users-for-a-load-test.html?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/@sinha.deepak/load-testing-beyond-1-000-users-are-we-testing-the-right-workload-49de3cb43046?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                   |
| [The Gate That Costs 640 Hours Per Bug](https://medium.com/@pradyush1989/the-gate-that-costs-640-hours-per-bug-031a35e27b68?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)Is your CI/CD pipeline slow? [Pradyush Badapanda](https://www.linkedin.com/in/pradyush-badapanda/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) advises counting how many bugs each gate catches before you cut any of them.Moreover, [María Evangelina Ferreira](https://www.linkedin.com/in/mariaevangelinaferreira/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shares why [Blocking gates got us listening to our own test results again](https://www.mabl.com/blog/blocking-pr-gates-test-ownership?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/@pradyush1989/the-gate-that-costs-640-hours-per-bug-031a35e27b68?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
| [The Test Automation Framework I Wish I'd Built 10 Years Ago (Part 1)](https://medium.com/@alwaysonlabs/the-test-automation-framework-i-wish-id-built-10-years-ago-part-1-d69e5795e685?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)A good article from [John Ringler](https://www.linkedin.com/in/johnringler/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) on how to build a [Cypress](https://www.cypress.io/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) or [Playwright](https://playwright.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) framework that scales. It also covers how each test can create its own data and run in any order. You can also read the [second part](https://medium.com/@alwaysonlabs/the-test-automation-framework-i-wish-id-built-10-years-ago-part-2-1c10713c047f?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).Furthermore, [Serhii Smetanskyi](https://www.linkedin.com/in/serhiismetanskyi/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) writes about [The Testing Pyramid: Everybody Knows It, Nobody Follows It](https://serhiismetanskyi.medium.com/the-testing-pyramid-everybody-knows-it-nobody-follows-it-4c30c475c9a8?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/@alwaysonlabs/the-test-automation-framework-i-wish-id-built-10-years-ago-part-1-d69e5795e685?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) |
| [The tests were green, and five of them were lying](https://medium.com/apra-labs-blog/the-tests-were-green-and-five-of-them-were-lying-e1c3e0688546?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)How do you make sure that AI-generated tests are correct? [Omkar Mujumdar](https://www.linkedin.com/in/omkarsm/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) advises using a second agent to implement the bug that the new test claims to catch.Moreover, [Jérémie Fleurant](https://www.linkedin.com/in/jeremie-fleurant?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) asks: [Who opens the report of a green run?](https://medium.com/@jeremie.fleurant/who-opens-the-report-of-a-green-run-c35951356ab7?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[medium.com](https://medium.com/apra-labs-blog/the-tests-were-green-and-five-of-them-were-lying-e1c3e0688546?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| Tools                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
| [I Used Maestro to Capture App Store Screenshots. It Found Real Bugs on the Way.](https://levelup.gitconnected.com/i-used-maestro-to-capture-app-store-screenshots-it-found-real-bugs-on-the-way-e09d436de534?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)[Dmitry Khorev](https://www.linkedin.com/in/dmitry-khorev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) describes how his screenshot runs in [Maestro](https://maestro.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) became the most useful test pass for the app.Also, [Ravi Rawal](https://www.linkedin.com/in/ravi-rawal-13/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shares an approach to [Harness Engineering for AI-Generated Maestro Tests](https://generativeai.pub/harness-engineering-ai-agents-maestro-ui-automation-94f46eebbf96?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[levelup.gitconnected.com](https://levelup.gitconnected.com/i-used-maestro-to-capture-app-store-screenshots-it-found-real-bugs-on-the-way-e09d436de534?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                  |
| [My Agent Harness Gave a Perfect Score to an Agent That Skipped 300 Updates](https://medium.com/dataaichronicles/my-agent-harness-gave-a-perfect-score-to-an-agent-that-skipped-300-updates-a04468d86736?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)Insightful lesson from [Ved Prakash](https://www.linkedin.com/in/ved-prakash-sde/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) on testing AI agents. Before you trust a perfect score, build an agent that's meant to fail and see if your checks catch it.In relation to that, [Yesha Shah](https://www.linkedin.com/in/yeshas93/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) wrote a good starting point on [Agentic Evals: Introduction to Autoraters (aka LLM-as-a-judge)](https://yeshas93.substack.com/p/agentic-evals-introduction-to-autoraters?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[medium.com](https://medium.com/dataaichronicles/my-agent-harness-gave-a-perfect-score-to-an-agent-that-skipped-300-updates-a04468d86736?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| [Playwright 1.65: Bun support, failure-only reports and what to check before upgrading](https://www.linkedin.com/pulse/playwright-165-bun-support-failure-only-reports-what-check-drajna-chtnf/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)Here's a handy summary from [Michal Drajna](https://www.linkedin.com/in/michaldrajna-qa?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) of the [Playwright](https://playwright.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) 1.65 release. The new exclusive test lock looks useful for the few tests that can't run in parallel with others.What's more, the Playwright team shared an important [Playwright and browser security reminder](https://x.com/playwrightweb/status/2117638981454291252?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[linkedin.com](https://www.linkedin.com/pulse/playwright-165-bun-support-failure-only-reports-what-check-drajna-chtnf/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| [Selenium 4.52 Fixed Trust Roots, Not Speed. Should You Still Migrate to Playwright?](https://pub.towardsai.net/selenium-4-52-fixed-trust-roots-not-speed-should-you-still-migrate-to-playwright-6f798bce5aa4?sk=8d59890e4acabd9655d9f83cce84121a&utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)This is a helpful comparison from [Shoaib Ahmed Quraishi](https://www.linkedin.com/in/shoebahmedquraishi/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) of the latest [Selenium](https://www.selenium.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) and [Playwright](https://playwright.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) releases, with a fair look at what download numbers and AI agents can and can't tell us.Similarly, [Shweta Gulati](https://www.linkedin.com/in/shweta-gulati94/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) describes a migration story: [We Moved from Cypress to Playwright Because of Tabs](https://medium.com/@shwetagulati.16march/we-moved-from-cypress-to-playwright-because-of-tabs-66cc2384adb7?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335).[pub.towardsai.net](https://pub.towardsai.net/selenium-4-52-fixed-trust-roots-not-speed-should-you-still-migrate-to-playwright-6f798bce5aa4?sk=8d59890e4acabd9655d9f83cce84121a&utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                 |
| [Writing Playwright scripts is no longer a six-figure skill. It's a $20/month AI subscription](https://www.linkedin.com/feed/update/urn:li:activity:7526126502426460160?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)Do you spend most of your day turning test cases into [Playwright](https://playwright.dev/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) code? [Vishvas Dhengula](https://www.linkedin.com/in/vishvas-dhengula?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) points out that AI does this well now and suggests where testers can add more value.On top of that, [Anton Gulin](https://www.linkedin.com/in/antongulin/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shares a tip on [Two Playwright tests, one account. Keep their data separate](https://www.anton.qa/blog/posts/parallel-playwright-account-data?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) if you want to run tests in parallel.[linkedin.com](https://www.linkedin.com/feed/update/urn:li:activity:7526126502426460160?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                       |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| Videos                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
| [GitHub Agentic Workflows Tutorial: Automate Your Repo with AI (Playwright MCP)](https://www.youtube.com/watch?v=V0Xz4bAH6Wg&utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)In this 15-minute recording, [Karthik KK](https://www.linkedin.com/in/karthikkk/?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) shows us how to use [GitHub Agentic Workflows](https://github.com/github/gh-aw?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) to run AI agents securely in CI, with an example of a Playwright test.[youtube.com](https://www.youtube.com/watch?v=V0Xz4bAH6Wg&utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| And…                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| [Standups in the age of AI...](https://www.linkedin.com/feed/update/urn:li:activity:7525134674399195136?utm%5Fsource=softwaretestingweekly&utm%5Fmedium=email&utm%5Fcampaign=issue-335) 😂                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| Thanks for reading!If you enjoy this newsletter and find it helpful in becoming a better tester, please consider sharing it with others.*[Dawid Dylowicz](https://www.linkedin.com/in/dawid-dylowicz/?ref=softwaretestingweekly.com)*                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |