Senior QA Automation Engineer (AI & LLM Testing)

Hungary, Hungary, Hungary • Posted July 02, 2026

Job Type: Full-time

Location: Hungary, Hungary

Posted: July 02, 2026

Category: Computer Occupations

Application Deadline: August 11, 2026

Role Description

Job Description
We are looking for a Senior QA Automation Engineer with strong hands-on experience in test automation, API testing, and AI/LLM quality evaluation.
Design, develop, and maintain automated test suites for web applications, APIs, and AI-powered features.
Evaluate LLM outputs for response accuracy, relevance, consistency, and hallucination risks.
Create prompt tests and quality checks using Promptfoo or similar LLM evaluation frameworks.
Build end-to-end UI automation using Playwright, following page object models and maintainable test architecture principles.
Develop reusable Python scripts for API testing, automation utilities, and LLM quality evaluation.
Create and maintain Postman collections for REST API testing, including environments, assertions, and CI/CD integration.
Use GitHub Copilot or similar AI coding assistants to improve test coverage, speed up automation development, and identify...
                

Interested in this role?

Click the button below to start your application for Senior QA Automation Engineer (AI & LLM Testing) at Nagarro.

Apply Now