This is a special end-of-year episode of the Automation Testing Podcast.
With family in town and a busy holiday season, Joe didn't want to skip a week without checking in and saying thank you to the TestGuild community.
In this short episode, Joe shares:
A huge milestone as the podcast approaches its 13-year anniversary
Why the Automation Testing Podcast is moving from Sundays to Tuesdays starting in 2026
How loyal listeners can still get $100 off a full 5-day Automation Guild 2026 pass
A sneak peek at TestGuild IRL — live, in-person events coming next year
Gratitude for the listeners, YouTube community, and sponsors who make TestGuild possible
If you're a software tester, automation engineer, or QA leader looking ahead to 2026, this episode lays out what's coming — and how to stay connected.
Discount code: 100GUILDCOIN (https://testguild.me/podag26) Questions or ideas? Email Joe directly at [email protected]
As always — test everything, and keep the good.
AI is transforming how software is built, but testing AI systems requires an entirely new mindset.
Don't miss AutomationGuild 2026 - Register Now: https://testguild.me/podag26
Use code TestGuildPod20 to get 20% off your ticket.
In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you're dealing with LLMs, RAG pipelines, and autonomous QA workflows.
You'll learn:
Why traditional pass/fail testing breaks down with LLMs
How to test non-deterministic AI outputs for consistency and accuracy
Practical techniques for detecting hallucinations, grounding issues, and prompt injection risks
How RAG systems change the way testers validate AI-powered applications
Where AI delivers quick wins today—and where human validation still matters
This conversation goes beyond hype and gets into real-world AI testing strategies QA teams are using right now to keep up with AI-generated code, faster release cycles, and DevOps velocity.
If you're a tester, automation engineer, or QA leader wondering how AI changes your role,not replaces it,this episode is your roadmap.
Automation Guild turns 10 this year, and the 2026 survey revealed some of the strongest trends and signals the testing community has ever shared.
Register now: https://testgld.link/ag26reg
In this episode, Joe breaks down the most important insights shaping Automation Guild 2026 and what they mean for testers, automation engineers, and QA leaders.
You'll hear why AI-powered testing is dominating every category, why Playwright has officially become the tool testers want most, the challenges that continue to follow teams year after year, and how testers are navigating shrinking teams, faster releases, and rising expectations.
This episode gives you a clear, data-driven snapshot of why Automation Guild 2026 matters — and how this year's event is designed to help you stay relevant, sharpen your skills, and tackle the problems that keep slowing down teams.
Perfect for anyone considering joining the Guild, planning their 2026 automation strategy, or just trying to make sense of the rapid changes happening in testing today.
In this solo episode, Joe Colantonio shares four powerful free TestGuild tools designed to help testers, automation engineers, and QA leaders work smarter. Discover how to instantly find the right testing tool for your team, assess automation risk, check your site's accessibility, and benchmark your automation maturity — all in one session.
Whether you're looking to improve test coverage, adopt better practices, or simply save time, these tools were built with you in mind.
What You'll Learn: – How to choose the right test automation tool fast – How to identify and reduce testing risk – How to check your site's accessibility compliance – How to assess your team's automation maturity level
Try the tools free:
Tool Matcher: https://testgld.link/toolmatcher Accessibility Scanner: https://testgld.link/scanner Risk Calc: https://testgld.link/riskcalc Automation Readiness Quiz: https://testgld.link/scorequiz
️ Join us for the 10th Annual Automation Guild Conference: https://testgld.link/IrHaNIVX
In this Halloween special, Joe Colantonio and Paul Grossman discuss the evolution of automation testing, focusing on the integration of AI tools, project management strategies, and the importance of custom logging. Paul shares insights from his recent job experience, detailing how he inherited a project and the challenges he faced. Paul also goes over his Optimus Prime framework and uses it to explore various automation tools, the significance of dynamic waiting, and how to handle test case collisions. The discussion also highlights the role of AI in enhancing automation frameworks and the importance of version control in software development.