Senior Korean Audio Expert

Role: Senior Korean Audio Expert at Keystone Recruitment

Keystone Recruitment is seeking a Senior Korean Audio Expert for one of its clients, a leading AI research organization. This fully remote, short-term engagement offers a unique opportunity to contribute to a high-impact audio AI research project. You will play a crucial role in training and benchmarking advanced language models through transcription, annotation, and evaluation tasks. This position is ideal for individuals with strong academic or analytical backgrounds who are fluent in both Korean and English, and who excel at translating complex audio and visual information into precise, structured text.

Key Responsibilities

• Define and Document Evaluation Standards: Establish clear expectations for correct and high-quality responses in general consumer audio contexts. Develop detailed evaluation rubrics and grading guidelines in both Korean and English. Document these standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing and Grading: Run prompts through language models and meticulously assess the generated outputs. Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance: Participate actively in QA and review cycles to ensure tasks, rubrics, and outputs consistently meet established quality standards. Maintain consistency and reliability before datasets are integrated into official benchmarks. Collaborate effectively with project leads to resolve ambiguities and continuously improve task design.

Minimum Qualifications

• Strong writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and consistently meet deadlines.
• Fluency in Korean and English, both spoken and written.
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates.
• Background in linguistics, humanities, social sciences, or technical fields.
• Prior experience with transcription, annotation, evaluation, or research workflows.
• Demonstrated interest in AI, language models, or applied research environments.

Additional Role Details

This engagement offers a structured, goal-oriented project environment, complete with clear tooling, guidelines, and comprehensive support. You will gain hands-on exposure to real-world AI research and evaluation workflows, contributing directly to cutting-edge advancements.

Contract and Payment Terms

This is an independent contractor engagement, fully remote with flexible scheduling. Project durations may vary based on performance and project needs. It is crucial to note that work will not involve access to confidential or proprietary information from any other employer, client, or institution. Payments are issued weekly via Stripe or Wise based on services rendered. Please be aware that H1-B or STEM OPT candidates cannot be supported at this time.

Key skills/competency

• Korean Language Proficiency
• English Language Proficiency
• Transcription
• Audio Annotation
• Language Model Evaluation
• Linguistics
• Critical Thinking
• Quality Assurance
• AI Research
• Technical Writing