Agentic AI Software Engineer – Test
Stello Inc. · India
- Hybrid
- Full-time
- ₹1,000,000 / year
- India
Job highlights
- Build AI agents for autonomous product testing.
- Ensure product quality through testing and validation.
- Automate workflows using Playwright for reliability.
- Collaborate with customers to understand use cases.
- Integrate AI testing into CI/CD pipelines.
About the role
Agentic AI Software Engineer – Test
Remote · Full-Time
About the Role
We are building the future of HR Tech. As an Agentic AI Software Engineer – Test, you will own quality across the entire product stack, from AI-driven automated pipelines to hands-on manual validation. Your goal is to ensure everything we ship works exactly as customers expect. This role sits at the intersection of AI, quality engineering, and product thinking. You will work closely with customers, understand real-world use cases, and translate them into robust testing strategies. You will build intelligent test agents, automate end-to-end workflows using Playwright, and act as the final quality gate before every release.
What You’ll Do
AI Agent Development
- Design and build AI agents that autonomously test product changes and detect regressions.
- Integrate AI-driven testing into CI/CD pipelines for fast, intelligent feedback on PRs.
- Improve prompting, evaluation logic, and tooling to increase coverage and reduce false positives.
Customer & Product Alignment
- Act as the quality advocate between customers and engineering.
- Understand customer workflows and translate them into clear acceptance criteria.
- Identify edge cases, gaps, and testability issues early in the development cycle.
- Ensure shipped features match customer expectations.
Automation Testing (Playwright)
- Build and maintain scalable end-to-end test suites using Playwright.
- Create reusable frameworks, page object models, and utilities.
- Integrate tests into CI/CD with strong reporting, traces, and debugging tools.
- Monitor and fix flaky tests to improve reliability.
Manual Testing & Release Validation
- Perform exploratory and structured testing before releases.
- Create test plans aligned with real customer scenarios.
- Execute regression, smoke, and edge-case testing across environments.
- Track and document bugs with clear reproduction steps.
What We’re Looking For
Technical Skills
- Strong experience with Playwright for browser automation.
- Solid programming skills in JavaScript (Node.js).
- Familiarity with AI-driven tools or LLM-based systems.
- Understanding of APIs, backend systems, and debugging workflows.
- Experience with CI/CD pipelines.
- Proficiency with Git and PR-based workflows.
Professional Skills
- Strong customer empathy and communication skills.
- Ability to translate requirements into testable outcomes.
- Experience with manual and exploratory testing.
- Ability to work independently across multiple workstreams.
Why Join Us
- Opportunity to build at an early-stage, high-growth AI company.
- High ownership and direct impact on product quality.
- Collaborative team that values craftsmanship, customer empathy, and transparency.
This is a hands-on engineering role. You should be comfortable writing and maintaining production-quality code and building robust automation, not just executing manual tests.
Key skills/competency
- Agentic AI Software Engineer Test
- AI Agent Development
- Playwright
- JavaScript
- Node.js
- CI/CD
- Quality Assurance
- Test Automation
- LLM
- Customer Empathy
Skills & topics
- Agentic AI Software Engineer Test
- AI
- Playwright
- JavaScript
- Node.js
- Automation
- Quality Assurance
- CI/CD
- LLM
- HR Tech
How to get hired
- Tailor your resume: Highlight Playwright, JavaScript, AI testing, and CI/CD experience.
- Showcase AI knowledge: Emphasize familiarity with LLMs and AI-driven tools.
- Demonstrate customer focus: Provide examples of translating requirements into tests.
- Prepare for technical questions: Be ready to discuss automation frameworks and debugging.
- Highlight collaboration skills: Discuss your experience working with cross-functional teams.
Technical preparation
Master Playwright for complex browser automation.,Build AI agents using JavaScript and LLM concepts.,Integrate automated tests into CI/CD pipelines.,Understand API testing and backend system debugging.
Behavioral questions
Describe a time you translated customer needs into tests.,How do you handle flaky tests and improve reliability?,Share an experience identifying critical product gaps.,How do you advocate for quality within a team?
Frequently asked questions
- What is the typical career path for an Agentic AI Software Engineer Test at Stello Inc.?
- At Stello Inc., an Agentic AI Software Engineer – Test can grow into a senior testing role, lead AI test strategy, or transition into broader AI engineering or product management positions, leveraging their deep understanding of product quality and customer needs.
- Does Stello Inc. offer opportunities for professional development in AI testing?
- Yes, Stello Inc. encourages professional development. As a high-growth AI company, they provide opportunities to learn and implement cutting-edge AI testing techniques, work with LLMs, and contribute to advanced automation frameworks.
- How does Stello Inc. balance AI-driven testing with manual quality assurance?
- Stello Inc. integrates AI-driven testing to enhance efficiency and coverage, especially for regression detection. Manual and exploratory testing are still crucial for identifying edge cases and validating against real-world customer scenarios, ensuring a comprehensive quality approach.
- What specific AI tools or LLMs are commonly used by the Agentic AI Software Engineer Test team at Stello Inc.?
- While specific tools evolve, the team at Stello Inc. focuses on leveraging AI and LLM-based systems for intelligent test agent development, prompting, and evaluation. Candidates should be familiar with general concepts and adaptable to new AI technologies.
- How does the Agentic AI Software Engineer Test role contribute to Stello Inc.'s HR Tech products?
- This role is vital for ensuring the reliability and accuracy of Stello Inc.'s HR Tech products. By owning quality across the stack, the engineer directly impacts customer satisfaction and the seamless functioning of AI-driven HR solutions.
- What is the expected level of coding proficiency for this Agentic AI Software Engineer Test role at Stello Inc.?
- This is a hands-on engineering role requiring production-quality code. You'll be expected to write and maintain robust JavaScript (Node.js) for automation and AI agent development, not just execute manual tests.