AI Tool Developer

AI Tool Developer

Are you passionate about leveraging AI to revolutionize test automation? We're looking for an innovative AI Tool Developer to design and implement advanced AI solutions that streamline and enhance our automation processes. This role involves creating end-to-end pipelines that convert natural language and structured test specifications into executable scripts, ensuring seamless integration with existing frameworks. A deep expertise in NLP, model fine-tuning, and AI/ML deployment is required to build scalable, compliant, and efficient automation solutions. Join us to make a significant impact by transforming how automation is powered through cutting-edge AI technologies.

Responsibilities:

• Develop an end-to-end AI model and processing pipeline that transforms natural language or structured test specifications into executable JSON scripts used by an internal test automation tool.
• Build prompt-driven, rule-augmented, or fine-tuned models using the approved AI platforms, ensuring compliance with internal AI/ML Review Board standards.
• Create data ingestion and training datasets using historical test cases, existing automation scripts, and test execution logs.
• Design the mapping framework between spec semantics and automation actions JSON schema.
• Build validation utilities to automatically ensure script correctness, schema compliance, and alignment with automation tool capabilities.
• Integrate the AI-generation pipeline into the existing test-automation toolchain and CI-based workflows.
• Collaborate with automation SMEs to refine domain-specific rules, edge cases, and test coverage requirements.
• Drive continuous model improvement through error analysis, incremental fine-tuning, and user feedback loops.
• Maintain documentation, versioning, and traceability of AI-generated scripts.
• Ensure responsible AI usage by aligning with the governance, data handling, and compliance requirements.
• Participate in OP monthly team meetings and contribute to team-building efforts.
• Contribute to OP technical discussions and peer reviews.
• Contribute content and collaborate via the OP-Wiki/Knowledge Base.
• Provide status reports to OP Account Management as requested.

Skills Required:

• 5+ years of experience building AI/ML or NLP-based solutions, including prompt engineering, LLM-based workflows, or model fine-tuning.
• Solid Python or similar development skills (data processing, model building, evaluation pipelines).
• Experience working with JSON schema design and automated test frameworks.
• Familiarity with ML frameworks such as PyTorch, TensorFlow, HuggingFace or similar libraries.
• Experience with building or integrating ML pipelines into production-quality tools (API services, microservices, or batch systems).
• Strong understanding of software testing concepts: test cases, assertions, conditions, flows, automation logic.
• Ability to collaborate with cross-functional engineering teams and translate ambiguous test definitions into structured logic.

Educational Background:

• Bachelor's Degree (or higher) in Computer Science, Management Information Systems, or related discipline, or equivalent professional work experience.

Added Bonus:

• Experience with automated test frameworks used in embedded or multimedia systems.
• Experience with model fine-tuning using enterprise datasets.
• Background in building developer tooling, code generation, or compiler/AST-type transformations.
• Familiarity with automation concepts or previous exposure to internal test automation pipelines.
• Experience implementing AI tools in enterprise environments requiring governance and model approval.

Benefits:

• 401(k)
• Dental Insurance
• Health insurance
• Vision insurance

We are an equal-opportunity employer and value diversity, equality, inclusion, and respect for people.

The salary will be determined based on several factors, including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs.

About us:

OP is a technology consulting and solutions company, offering advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields - including AI, cybersecurity, enterprise architecture, and beyond. Our most valuable asset is our people: dynamic, creative thinkers who are passionate about doing quality work. As a member of the OP team, you will have access to industry-leading consulting practices, strategies & and technologies, innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology.

Key skills/competency

• AI Tool Developer
• NLP
• Model Fine-tuning
• Prompt Engineering
• Python
• JSON Schema
• Test Automation
• ML Pipelines
• HuggingFace
• PyTorch