LLM Data Quality Specialist
Nexus Consulting
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview: LLM Data Quality Specialist at Nexus Consulting
Nexus Consulting, a global AI-focused organization, is looking for an LLM Data Quality Specialist to support large language model training through structured data validation and lightweight tooling development. This role combines hands-on quality control with practical tool-building, aiming to enhance dataset reliability, clarity, and evaluation standards across STEM and humanities domains.
You will collaborate closely with internal experts and AI teams to ensure training data adheres to rigorous quality standards, while simultaneously developing simple, effective workflows to scale review processes.
Key Responsibilities
- Perform quality checks (QC) on generated datasets including Q&A pairs, rubric-based datasets, evaluation samples, and agentic workflows.
- Review content across both STEM and humanities domains for logical consistency, accuracy, clarity, and completeness.
- Develop clear, actionable QC guidelines to empower domain experts to independently review their samples.
- Design and build lightweight Python-based utilities (primarily in Google Colab) to streamline validation workflows.
- Translate quality requirements into structured review checklists, scripts, and semi-automated tools.
- Identify recurring data issues and recommend process improvements.
- Communicate findings clearly and professionally to cross-functional stakeholders.
Required Qualifications
- Strong analytical thinking and attention to detail.
- Experience performing structured content validation or quality assurance.
- Proficiency in Python (especially for lightweight scripting and automation).
- Comfortable working in Google Colab or similar notebook environments.
- Ability to convert ambiguous QC requirements into practical workflows and tools.
- Excellent written communication skills.
- Ability to work full-time with required PST overlap.
Engagement Details
- Contractor assignment (independent contractor, no medical/paid leave).
- Full-time commitment with 4 hours of overlap with PST.
- Duration: 10 months, with potential for extension.
- Fully remote position.
Key skills/competency
- LLM Data Quality
- Data Validation
- Python Scripting
- Google Colab
- Quality Assurance
- Content Review
- Analytical Thinking
- Workflow Automation
- Process Improvement
- Cross-functional Communication
How to Get Hired at Nexus Consulting
- Research Nexus Consulting's mission: Study their focus on AI and data quality to align your application.
- Highlight LLM and Python expertise: Customize your resume to showcase data quality, validation, and Python scripting for AI.
- Tailor your cover letter: Emphasize experience in structured content review and developing validation tools for LLMs.
- Prepare for technical assessments: Practice Python scripting in Google Colab and discuss data quality methodologies.
- Showcase problem-solving skills: Be ready to discuss how you identify and resolve data issues in an interview.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background