AI QA Engineer

AI QA Engineer at ID Privacy AI

Does being involved in engineering a fundamental evolution of the Internet get you excited to go to work? Do you care about consumer’s privacy online and want to work to improve it? If so, ID Privacy AI is seeking an AI QA Engineer specifically for its AI platform to build both code and content end-to-end testing processes and be the implementer to work with the engineers on a day-to-day basis to do the actual QA testing.

Consumer privacy is top of mind in today’s advertising industry. Regulators worldwide are now forcing browser and other platform vendors to build in consumer privacy from the ground up. These changes to both the browser- and server- side are literally a major overhaul of the wiring of the entire Internet as we experience it today.

ID Privacy AI believes that consumer privacy is a right, not an option. We view the rewiring of AdTech platforms as an opportunity to look forward and create effective advertising platforms that are privacy-preserving from the get-go. At ID Privacy AI, we are not beholden to the past. What we are doing is looking to where online advertising will be five or even ten years from now and designing for that future.

Summary

As our AI QA Engineer, you will be responsible for three core elements:

• Developing an overarching approach to QA and then designing processes to implement that approach.
• Developing and executing exploratory and automated regression testing to ensure code quality.
• Developing and executing exploratory and regression testing for AI-generated content to ensure its accuracy and remove hallucination.

Your duties will include designing and implementing tests, debugging, and defining corrective actions. You will also review system requirements and track quality assurance metrics. The AI QA Engineer role plays an important part in the company’s product development process. You will be expected to monitor all stages of software development to identify and resolve system malfunctions to meet quality standards.

To ensure success as an AI QA Engineer, you should have strong analytical skills, attention to detail, and a passion for delivering high-quality products. Top-class AI QA Engineers are dedicated to improving the product development process to ensure the highest quality and performance of our applications.

Main Tasks And Responsibilities

• QA System conceptualization and design.
• Review and analyze system specifications.
• Collaborate with developers and product managers to develop effective strategies and test plans.
• Execute test cases (manual or automated) and analyze results.
• Evaluate product code according to specifications.
• Create logs to document testing phases and defects.
• Report bugs and errors to development teams.
• Help troubleshoot issues.
• Conduct post-release/post-implementation testing.
• Work with cross-functional teams to ensure quality throughout the software development lifecycle.
• Attend weekly project meetings, leadership calls, and external client calls as needed.
• Perform other duties as assigned by the supervisor.

Required Qualifications

• 4+ years of professional experience and a bachelor’s degree in computer science, engineering, or a related field.
• Understanding of testing and debugging of LLMs and LLM-derived products.
• Highly organized and disciplined around QA testing, debugging, and bug prioritization.
• Proven experience as a quality assurance tester or similar role.
• Experience in project management and QA methodologies.
• Familiarity with agile frameworks and regression testing.
• Ability to document and troubleshoot errors.
• Working knowledge of test management software (e.g., QTest, Zephyr) and SQL.
• Excellent communication skills.
• Attention to detail.
• Analytical mind and problem-solving aptitude.

Preferred Qualifications

• Experience with automated testing tools (e.g., Selenium, JMeter).
• Knowledge of programming languages (e.g., Java, Python) is a plus.
• Experience in performance testing.
• Familiarity with continuous integration tools (e.g., Jenkins, Bamboo).
• Must have valid US identification for FTE roles.
• Must be able to successfully pass a background screen test.

About ID Privacy AI

Tech Headquartered in Silicon Valley, ID Privacy AI is dedicated to building a next-generation privacy-first platform for online advertising. ID Privacy AI is led by top executives from the online advertising industry. We are thought leaders who welcome the changes to enhance consumer privacy that are occurring to browsers, mobile, CTV, and DOOH platforms. We help our customers navigate these changes and optimize their infrastructure to take advantage of the opportunities inherent in this major shift.

Key skills/competency

• AI testing
• LLM debugging
• QA methodologies
• Automated testing
• Regression testing
• SQL
• Agile frameworks
• Software development lifecycle
• Test management
• Problem-solving