
AI Tool Developer
TalentAlly · Plano, TX
- On site
- Full-time
- $120,000 / year
- Plano, TX
Email the hiring manager to get a response.
Get their verified email + an intro that's ready to send.
Subject: Interested in the AI Tool Developer role at TalentAlly
Hi Riley — I came across the AI Tool Developer opening and wanted to reach out directly. I've spent the last few years doing exactly this kind of work, and TalentAlly stood out because…
✎ Personalized to your résumé after sign-up.
- ✓ Verified email of the hiring manager
- ✓ Intro email personalized to your résumé
- ✓ $9/mo = unlimited — any job link
Secure checkout · cancel anytime
Job highlights
- Develop AI models for test automation.
- Transform specifications into executable scripts.
- Utilize NLP, fine-tuning, and prompt engineering.
- Integrate AI pipelines into existing tools.
- Collaborate with automation subject matter experts.
About the role
AI Tool Developer
Are you passionate about leveraging AI to revolutionize test automation? We're looking for an innovative AI Tool Developer to design and implement advanced AI solutions that streamline and enhance our automation processes. This role involves creating end-to-end pipelines that convert natural language and structured test specifications into executable scripts, ensuring seamless integration with existing frameworks. A deep expertise in NLP, model fine-tuning, and AI/ML deployment is required to build scalable, compliant, and efficient automation solutions. Join us to make a significant impact by transforming how automation is powered through cutting-edge AI technologies.
Responsibilities:
- Develop an end-to-end AI model and processing pipeline that transforms natural language or structured test specifications into executable JSON scripts used by an internal test automation tool.
- Build prompt-driven, rule-augmented, or fine-tuned models using the approved AI platforms, ensuring compliance with internal AI/ML Review Board standards.
- Create data ingestion and training datasets using historical test cases, existing automation scripts, and test execution logs.
- Design the mapping framework between spec semantics and automation actions JSON schema.
- Build validation utilities to automatically ensure script correctness, schema compliance, and alignment with automation tool capabilities.
- Integrate the AI-generation pipeline into the existing test-automation toolchain and CI-based workflows.
- Collaborate with automation SMEs to refine domain-specific rules, edge cases, and test coverage requirements.
- Drive continuous model improvement through error analysis, incremental fine-tuning, and user feedback loops.
- Maintain documentation, versioning, and traceability of AI-generated scripts.
- Ensure responsible AI usage by aligning with the governance, data handling, and compliance requirements.
- Participate in OP monthly team meetings and contribute to team-building efforts.
- Contribute to OP technical discussions and peer reviews.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
Skills Required:
- 5+ years of experience building AI/ML or NLP-based solutions, including prompt engineering, LLM-based workflows, or model fine-tuning.
- Solid Python or similar development skills (data processing, model building, evaluation pipelines).
- Experience working with JSON schema design and automated test frameworks.
- Familiarity with ML frameworks such as PyTorch, TensorFlow, HuggingFace or similar libraries.
- Experience with building or integrating ML pipelines into production-quality tools (API services, microservices, or batch systems).
- Strong understanding of software testing concepts: test cases, assertions, conditions, flows, automation logic.
- Ability to collaborate with cross-functional engineering teams and translate ambiguous test definitions into structured logic.
Educational Background:
- Bachelor's Degree (or higher) in Computer Science, Management Information Systems, or related discipline, or equivalent professional work experience.
Added Bonus:
- Experience with automated test frameworks used in embedded or multimedia systems.
- Experience with model fine-tuning using enterprise datasets.
- Background in building developer tooling, code generation, or compiler/AST-type transformations.
- Familiarity with automation concepts or previous exposure to internal test automation pipelines.
- Experience implementing AI tools in enterprise environments requiring governance and model approval.
Benefits:
- 401(k)
- Dental Insurance
- Health insurance
- Vision insurance
We are an equal-opportunity employer and value diversity, equality, inclusion, and respect for people.
The salary will be determined based on several factors, including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs.
About us:
OP is a technology consulting and solutions company, offering advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields - including AI, cybersecurity, enterprise architecture, and beyond. Our most valuable asset is our people: dynamic, creative thinkers who are passionate about doing quality work. As a member of the OP team, you will have access to industry-leading consulting practices, strategies & and technologies, innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology.
Key skills/competency
- AI Tool Developer
- NLP
- Model Fine-tuning
- Prompt Engineering
- Python
- JSON Schema
- Test Automation
- ML Pipelines
- HuggingFace
- PyTorch
Skills & topics
- AI Tool Developer
- AI
- Machine Learning
- NLP
- Python
- Test Automation
- Prompt Engineering
- LLM
- HuggingFace
- TensorFlow
- PyTorch
- JSON Schema
- Software Development
- Tech Consulting
How to get hired
- Tailor your resume: Highlight AI/ML, NLP, Python, and test automation experience.
- Showcase your projects: Detail your experience with LLM workflows and model fine-tuning.
- Prepare for technical interviews: Brush up on Python, JSON schema, and ML frameworks.
- Demonstrate collaboration: Emphasize your ability to work with cross-functional teams.
Technical preparation
Behavioral questions
Frequently asked questions
- What is the primary goal of the AI Tool Developer role at TalentAlly?
- The primary goal is to design and implement advanced AI solutions to revolutionize test automation by creating end-to-end pipelines that convert natural language and structured test specifications into executable scripts.
- What technical skills are essential for an AI Tool Developer at TalentAlly?
- Essential technical skills include 5+ years of experience in AI/ML or NLP, strong Python development, JSON schema design, experience with ML frameworks like PyTorch or TensorFlow, and ML pipeline integration.
- What kind of models will the AI Tool Developer be building?
- The AI Tool Developer will build prompt-driven, rule-augmented, or fine-tuned models using approved AI platforms, ensuring compliance with internal AI/ML Review Board standards.
- How does this role contribute to TalentAlly's broader goals?
- This role directly contributes to TalentAlly's goal of transforming automation processes through cutting-edge AI technologies, making automation more efficient, scalable, and compliant.
- What is the expected educational background for this position?
- A Bachelor's Degree (or higher) in Computer Science, Management Information Systems, or a related discipline, or equivalent professional work experience, is expected.
- What are some 'added bonus' qualifications for an AI Tool Developer at TalentAlly?
- Added bonuses include experience with automated test frameworks in embedded/multimedia systems, fine-tuning with enterprise datasets, developer tooling, code generation, or implementing AI in enterprise environments with governance.
- How will the AI-generated scripts be validated?
- Validation utilities will be built to automatically ensure script correctness, schema compliance, and alignment with the capabilities of the automation tool.
- What does 'responsible AI usage' entail in this role?
- Responsible AI usage involves aligning with governance, data handling, and compliance requirements as mandated by the company's AI/ML Review Board standards.
Similar roles
Open positions we recommend based on this role.
