Senior QA Engineer
Jobgether
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Senior QA Engineer
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior QA Engineer. In this role, you will take charge of leading our automated testing efforts, focusing on innovative AI features and non-deterministic systems. Your expertise will significantly contribute to improving the quality of our AI agents and LLM pipelines. You will collaborate closely with AI researchers and developers to define quality metrics and ensure robust testing strategies. This is a pivotal role that not only enhances product quality but also shapes the future of enterprise automation.
Accountabilities
- Own the E2E framework: Build, maintain, and scale our automated testing framework using Playwright (TypeScript/Python).
- Test the unpredictable: Design strategies to test non-deterministic LLM outputs, AI agents, and RAG pipelines.
- Tackle LLM-specific challenges: Build guardrails and automated checks for prompt drift and hallucinations.
- Evaluate Agent behavior: Create scenarios to test how AI agents handle edge cases and multi-step reasoning.
- Integrate and collaborate: Wire tests into our CI/CD pipelines, ensuring consistency with AI logic.
Requirements
- 5+ years in QA Automation or Software Engineering in Test (SDET).
- Deep, hands-on experience with Playwright for reliable test suite development.
- Strong programming skills in TypeScript, JavaScript, or Python.
- Understanding of LLMs and their testing challenges.
- Systems thinking for analyzing complex architectures.
- Excellent communication skills to explain QA issues clearly.
Benefits
- Freedom and ownership of impactful work.
- Positive organizational culture focused on personal and professional growth.
- Commitment to diversity and inclusion.
- Top market compensation package including company shares.
- Personal development budget, meal allowance, and recreational activities.
Key skills/competency
- QA Automation
- Playwright
- TypeScript
- Python
- LLM Testing
- AI Agents
- CI/CD Integration
- Non-deterministic Systems
- Test Strategy
- System Architecture
How to Get Hired at Jobgether
- Research the partner company's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor to understand who they are.
- Tailor your resume for QA Automation: Customize your resume to highlight extensive experience in QA automation, Playwright, TypeScript/Python, and testing AI/LLM systems.
- Showcase LLM testing expertise: Emphasize your ability to design testing strategies for non-deterministic AI outputs, RAG pipelines, and agent behavior during interviews.
- Prepare for technical and system design questions: Be ready to discuss your hands-on Playwright experience, CI/CD integration, and how you approach testing complex AI architectures.
- Demonstrate strong communication: Practice clearly explaining complex QA issues and your collaboration approach with AI researchers and developers.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background