Interaction with LLMs in Test Automation


Filip Hric

29th January 2025

Interaction with LLMs in Test Automation

Hello Reader,
Large Language Models (LLMs) like ChatGPT are making waves in test automation. But how are we actually using them? I recently ran a poll to find out, and the results were interesting.

  • 68% of respondents interact via Chat UIs like ChatGPT or Claude.
  • 23% prefer IDE integrations like GitHub CoPilot.
  • 7% rely on direct API access for greater control.

Each approach has its unique benefits and challenges, and the comments provided even more valuable insights.


Your Options in Practice

  • Chat UI: Great for quick debugging, brainstorming, or improving code reviews. As one user noted, it’s like pair programming with an AI subject expert—though sometimes prone to "silly mistakes."
  • IDE Integrations: Tools like CoPilot and Cursor streamline workflows by offering in-code assistance, speeding up development while reducing manual tasks.
  • Direct API Access: Offers the option to create your own interface. Some even created a free test case generator using this method!

Blogposts, discussions, events

Migrating my test suite with AI

Tomorrow! Let’s put AI to some practical use. On the upcoming livestream, we’ll be migrating a whole test suite and talk about caveats and approaches when facing a project of such scale.

​Join us on a livestream→​

Component Testing With Murat Ozcan: Cy vs Pw vs Vitest

Two of the smartest people I know got together to talk about component test. It’s a really valuable video to watch if you want to learn about the value component testing brings

​Watch video →​

99 Cypress tips coming on Monday!

We're really close now! In just a few days, I'll be releasing my latest course with great tips for you, too. Follow me and elevate your end-to-end testing skills in no time!

​Follow my website →​


Test automation tip

Ever tried to test maps with Cypress? Getting client’s geolocation requires consent from their browser. With cypress-browser-permissions plugin you can set them up and then use stub the browser into any location you need.

 1  cy.visit('/contact', {
 2      onBeforeLoad ({ navigator }) {
 3        // Košice city
 4        const latitude = 48.71597183246423
 5        const longitude = 21.255670821215418
 6       cy.stub(navigator.geolocation, 'getCurrentPosition')
 7         .callsArgWith(0, { coords: { latitude, longitude } })
 8      }
 9    })

Meme of the week


Filip Hric

Teaching testers about development, and developers about testing

filip@filiphric.sk, Senec, Slovakia 90301
​Unsubscribe · Preferences​

Filip Hric

Sign up for weekly tips on testing, development, and everything related. Unsubscribe anytime you feel like you had enough 😊

Read more from Filip Hric

Filip Hric 13th May 2025 TO BE OR NOT TO BE (TECHNICAL) Hey Reader!There’s an ongoing debate in the QA world on whether it makes sense to get technical or not. I remember having a fairly heated debate on this last November at Agile Testing Days in Potsdam. My talk titled "Test like a developer, develop like a tester" argued that we should put the effort as testers to become experts in the software we test. And yes, that includes having a fair bit of developer knowledge. Jason Arbon called...

Filip Hric 23rd April 2025 AN APP CAN BE A HOME-COOKED MEAL He Reader,Today I’d love to share with you one of the best blogposts I’ve ever read. It warmed my heart and inspired me greatly. The blogpost is called "An app can be a home-cooked meal". Give it a read. It taps into something that’s really close to my heart - using your talents to make a world a better place - starting with your family. While you can be a world-renowned chef, it will always feel different when you cook a meal for...

Filip Hric 24th March 2025 Playwright in Production Hello Reader,I’ll be doing a live webinar with my friend Jonathan tomorrow. We’ll be talking about different use-cases of Playwright in production. Interestingly we’ll focus on use cases that are outside of testing, like web-scraping, monitoring and automation workflows. Make sure to register and join us! Register here Blogposts, discussions, events In Case You Missed It – Code (r)evolution Livestream Last week, Jonathan and I unpacked...