Agentic AI Software Engineer – Test
Stello Inc. · India
- Hybrid
- Full-time
- $120,000 / year
- India
Job highlights
- Build AI agents for autonomous product testing.
- Automate end-to-end workflows using Playwright.
- Ensure product quality aligns with customer needs.
- Collaborate with customers and engineering teams.
- Work in a flexible remote/hybrid AI company.
About the role
About the Role
We are building the future of HR Tech. As an Agentic AI Software Engineer – Test, you will own quality across the entire product stack, from AI-driven automated pipelines to hands-on manual validation. Your goal is to ensure everything we ship works exactly as customers expect. This role sits at the intersection of AI, quality engineering, and product thinking. You will work closely with customers, understand real-world use cases, and translate them into robust testing strategies. You will build intelligent test agents, automate end-to-end workflows using Playwright, and act as the final quality gate before every release.What You’ll Do
AI Agent Development
- Design and build AI agents that autonomously test product changes and detect regressions
- Integrate AI-driven testing into CI/CD pipelines for fast, intelligent feedback on PRs
- Improve prompting, evaluation logic, and tooling to increase coverage and reduce false positives
Customer & Product Alignment
- Act as the quality advocate between customers and engineering
- Understand customer workflows and translate them into clear acceptance criteria
- Identify edge cases, gaps, and testability issues early in the development cycle
- Ensure shipped features match customer expectations
Automation Testing (Playwright)
- Build and maintain scalable end-to-end test suites using Playwright
- Create reusable frameworks, page object models, and utilities
- Integrate tests into CI/CD with strong reporting, traces, and debugging tools
- Monitor and fix flaky tests to improve reliability
Manual Testing & Release Validation
- Perform exploratory and structured testing before releases
- Create test plans aligned with real customer scenarios
- Execute regression, smoke, and edge-case testing across environments
- Track and document bugs with clear reproduction steps
What We’re Looking For
Technical Skills
- Strong experience with Playwright for browser automation
- Solid programming skills in JavaScript (Node.js)
- Familiarity with AI-driven tools or LLM-based systems
- Understanding of APIs, backend systems, and debugging workflows
- Experience with CI/CD pipelines
- Proficiency with Git and PR-based workflows
Professional Skills
- Strong customer empathy and communication skills
- Ability to translate requirements into testable outcomes
- Experience with manual and exploratory testing
- Ability to work independently across multiple workstreams
Why Join Us
- Flexible remote / hybrid work setup
- Health coverage
- Opportunity to build at an early-stage, high-growth AI company
- High ownership and direct impact on product quality
- Collaborative team that values craftsmanship, customer empathy, and transparency
Key skills/competency
- Agentic AI Software Engineer
- AI Agent Development
- Playwright Automation
- JavaScript (Node.js)
- CI/CD Pipelines
- API Testing
- Quality Assurance
- Test Automation
- LLM Systems
- Customer Empathy
Skills & topics
- Agentic AI Software Engineer
- AI Testing
- Playwright
- JavaScript
- Node.js
- Quality Assurance
- Test Automation
- CI/CD
- LLM
- HR Tech
How to get hired
- Tailor your resume: Highlight JavaScript (Node.js), Playwright, AI/LLM experience, and CI/CD familiarity.
- Showcase your skills: Provide examples of building test automation or AI agents.
- Understand Stello Inc.: Research their HR Tech focus and AI-driven approach.
- Prepare for technical questions: Be ready to discuss Playwright, API testing, and debugging.
- Demonstrate customer empathy: Articulate how you translate customer needs into tests.
Technical preparation
Master Playwright for browser automation.,Build AI agents using LLMs.,Develop robust JavaScript (Node.js) code.,Integrate tests into CI/CD pipelines.
Behavioral questions
Describe a complex customer workflow.,How do you ensure shipped features meet expectations?,How do you handle flaky tests?,How do you translate requirements into tests?
Frequently asked questions
- What is an Agentic AI Software Engineer at Stello Inc.?
- An Agentic AI Software Engineer at Stello Inc. focuses on ensuring product quality through AI-driven testing, automation with Playwright, and understanding customer needs. This role involves building intelligent test agents and working at the intersection of AI, quality engineering, and product.
- What programming languages are required for this role at Stello Inc.?
- The primary programming language required for this Agentic AI Software Engineer role at Stello Inc. is JavaScript, specifically within the Node.js environment. Familiarity with AI-driven tools is also essential.
- Does Stello Inc. offer remote work for this position?
- Yes, Stello Inc. offers a flexible remote or hybrid work setup for the Agentic AI Software Engineer position, allowing for a work arrangement that suits your needs.
- What kind of AI experience is Stello Inc. looking for?
- Stello Inc. is looking for candidates with familiarity with AI-driven tools or LLM-based systems. This includes designing and building AI agents to autonomously test product changes and detect regressions.
- What is the primary automation tool used at Stello Inc. for this role?
- The primary automation tool for this Agentic AI Software Engineer role at Stello Inc. is Playwright. Experience with Playwright for browser automation is a key technical skill requirement.
- How does Stello Inc. approach product quality for its HR Tech solutions?
- Stello Inc. approaches product quality by owning it across the entire stack, from AI-driven pipelines to manual validation. They emphasize customer expectations, using robust testing strategies and acting as the final quality gate before releases.
- What are the typical responsibilities of a Manual Testing & Release Validation role at Stello Inc.?
- Responsibilities include performing exploratory and structured testing, creating test plans based on customer scenarios, executing various types of tests (regression, smoke, edge-case), and documenting bugs with clear reproduction steps for the Agentic AI Software Engineer position.