AI QA Engineer - GenAI
@ GE Vernova

Niskayuna, NY
$120,000
On Site
Full Time
Posted 1 day ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXX XXXXXXXXX***** @ge.com
Recommended after applying

Job Details

Overview

GE Vernova is seeking a highly skilled AI QA Engineer - GenAI to lead the development of benchmark frameworks for AI systems and use cases deployed. This role ensures the accuracy, reliability, safety, and compliance of AI models driving innovation at GE Vernova.

Responsibilities

  • Design, develop, and execute comprehensive benchmark frameworks for AI use cases.
  • Develop automated testing suites to validate AI functionalities and performance.
  • Collaborate with Prompt Engineers, AI Agent Engineers and product owners to define quality standards and KPIs.
  • Conduct quantitative and qualitative evaluations of AI outputs against business and regulatory standards.
  • Monitor AI use case performance, identify issues, and recommend improvements.
  • Document testing methodologies, framework designs, and quality metrics for stakeholders.
  • Support continuous improvement with new benchmarking techniques and feedback loops.
  • Provide training and mentorship on AI testing best practices.
  • Stay current with emerging AI technologies, contributing to platform and tooling improvements.

Required Qualifications and Skills

  • Master’s degree in Computer Science, AI Engineering, Data Science, or related field.
  • 3+ years of software quality assurance experience with 2+ years focused on AI/ML systems.
  • Proven track record in designing AI benchmark frameworks and QA strategies.
  • Strong programming skills in Python and experience with automated testing frameworks like pytest and Selenium.
  • Familiarity with RAG systems, vector databases, and GenAI architectures.
  • Deep understanding of machine learning models, LLMs, and AI validation methodologies.
  • Experience with AI fairness, bias detection, and ethical AI practices.
  • Knowledge of cloud environments (AWS, Azure, or GCP), containerization and deployment pipelines.
  • Experience in handling quantitative and qualitative performance metrics.
  • Hands-on experience with LLMs, prompt engineering, NLP, and agent orchestration platforms.

Additional Information

GE Vernova offers a great work environment, professional development, challenging careers, and competitive compensation. Employment is subject to a drug screen and legal work authorization in the United States. Relocation assistance is provided.

Key skills/competency

  • Benchmarking
  • Automated Testing
  • Python
  • AI QA
  • ML Models
  • LLMs
  • Prompt Engineering
  • NLP
  • Regulatory Compliance
  • Cloud
Apply without a personalized resume

How to Get Hired at GE Vernova

🎯 Tips for Getting Hired

  • Tailor your resume: Highlight relevant AI QA and testing experience.
  • Research GE Vernova: Understand their AI culture and innovation.
  • Customize cover letter: Emphasize your framework design achievements.
  • Prepare for technical interviews: Review Python and AI testing concepts.
  • Practice behavioral questions: Outline teamwork and mentoring experiences.

📝 Interview Preparation Advice

Technical Preparation

Review Python automated testing frameworks.
Study AI benchmarking techniques.
Brush up on cloud deployment fundamentals.
Practice evaluating AI performance metrics.

Behavioral Questions

Describe a challenging QA project.
Explain teamwork under pressure.
Discuss mentoring experiences in testing.
Share problem-solving strategies.

Frequently Asked Questions