Hindi Audio Quality Analyst

Role Overview

Keystone Recruitment's client, a leading AI research organization, is seeking a Hindi Audio Quality Analyst Expert to contribute to a high-impact audio AI research project. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.

This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Hindi and English and enjoy translating complex audio and visual information into precise, well-structured text.

Key Responsibilities

• Transcribe and Optimize Audio & Video: Listen to, analyze, and transcribe audio and video content in Hindi while following detailed constraints and instructions. Produce high-quality written outputs, with supporting work in English when required. Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.
• Define and Document Evaluation Standards: Establish clear expectations for correct and high-quality responses in general consumer audio contexts. Develop detailed evaluation rubrics and grading guidelines in Hindi and English. Document standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing and Grading: Run prompts through language models and assess generated outputs. Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance: Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet established quality standards. Maintain consistency and reliability before datasets are integrated into official benchmarks. Collaborate with project leads to resolve ambiguities and improve task design.

Minimum Qualifications

• Strong writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Fluency in Hindi and English (spoken and written).
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates.
• Background in linguistics, humanities, social sciences, or technical fields.
• Prior experience with transcription, annotation, evaluation, or research workflows.
• Interest in AI, language models, or applied research environments.

Contract and Payment Terms

• Engagement as an independent contractor.
• Fully remote with flexible scheduling.
• Projects may be extended, shortened, or concluded based on performance and project needs.
• Work does not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are issued weekly via Stripe or Wise based on services rendered.
• H1-B or STEM OPT candidates cannot be supported at this time.

Key skills/competency

• Hindi Fluency
• English Fluency
• Transcription
• Audio Annotation
• Language Model Evaluation
• Critical Thinking
• Quality Assurance (QA)
• Linguistic Analysis
• Content Optimization
• Rubric Development