7 days ago

LLM Data Quality

Quik Hire Staffing

Hybrid
Contractor
$156,000
Hybrid

Job Overview

Job TitleLLM Data Quality
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$156,000
LocationHybrid

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

Role Overview

A global AI-focused organization is seeking an LLM Data Quality & Tooling Specialist to support large language model training initiatives through structured data validation and lightweight tooling development. This LLM Data Quality role blends hands-on quality control with practical tool-building to improve dataset reliability, clarity, and evaluation standards across STEM and humanities domains.

You will work closely with internal experts and AI teams to ensure training data meets rigorous quality standards while building simple, effective workflows to scale review processes.

Key Responsibilities

  • Perform quality checks (QC) on generated datasets including Q&A pairs, rubric-based datasets, evaluation samples, and agentic workflows
  • Review content across both STEM and humanities domains for logical consistency, accuracy, clarity, and completeness
  • Develop clear, actionable QC guidelines to help domain experts independently review their samples
  • Design and build lightweight Python-based utilities (primarily in Google Colab) to streamline validation workflows
  • Translate quality requirements into structured review checklists, scripts, and semi-automated tools
  • Identify recurring data issues and recommend process improvements
  • Communicate findings clearly and professionally to cross-functional stakeholders

Required Qualifications

  • Strong analytical thinking and attention to detail
  • Experience performing structured content validation or quality assurance
  • Proficiency in Python (especially for lightweight scripting and automation)
  • Comfortable working in Google Colab or similar notebook environments
  • Ability to convert ambiguous QC requirements into practical workflows and tools
  • Excellent written communication skills
  • Ability to work full-time with required PST overlap

Engagement Details

  • Contractor assignment (no medical/paid leave)
  • Full-time commitment with 4 hours of overlap with PST
  • Duration: 10 months
  • Fully remote
  • Potential for contract extension based on performance

Evaluation Process

  • Job interest form
  • Interview
  • Selection and onboarding

Key skills/competency

  • LLM Data Quality
  • Structured Data Validation
  • Python Scripting
  • Google Colab
  • Content Review
  • Quality Assurance (QA)
  • Data Analysis
  • Process Improvement
  • Analytical Thinking
  • Cross-functional Communication

Tags:

LLM Data Quality Specialist
data quality
validation
content review
tooling
Python scripting
data analysis
process improvement
quality assurance
dataset evaluation
analytical thinking
Python
Google Colab
AI
NLP
large language models
data engineering
scripting
automation
machine learning

Share Job:

How to Get Hired at Quik Hire Staffing

  • Research Quik Hire Staffing's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor to align your application.
  • Tailor your resume for LLM Data Quality: Highlight experience in data validation, Python scripting, and quality assurance, using keywords from the job description.
  • Showcase Google Colab and Python skills: Provide examples of lightweight tooling development or automation projects relevant to data quality.
  • Prepare for a technical interview: Be ready to discuss your analytical thinking, attention to detail, and problem-solving approach to data issues.
  • Emphasize communication and process improvement: Demonstrate your ability to articulate findings and suggest enhancements for data quality workflows.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background