Senior Korean Audio Expert

Role: Senior Korean Audio Expert

Keystone Recruitment's client, a leading AI research organization, is seeking a Senior Korean Audio Expert to contribute to a high-impact audio AI research project. This role focuses on transcription, annotation, and evaluation tasks crucial for training and benchmarking advanced language models.

This structured, short-term engagement is perfect for individuals with strong academic or analytical backgrounds who are fluent in both Korean and English. You will be translating complex audio and visual information into precise, well-structured text.

Key Responsibilities

• Define and Document Evaluation Standards: Establish clear expectations for correct and high-quality responses in general consumer audio contexts. Develop detailed evaluation rubrics and grading guidelines in both Korean and English. Document these standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing and Grading: Run prompts through language models and assess the generated outputs. Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance: Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet established quality standards. Maintain consistency and reliability before datasets are integrated into official benchmarks. Collaborate with project leads to resolve ambiguities and improve task design.

Minimum Qualifications

• Strong writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Fluency in Korean and English (spoken and written).
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates.
• Background in linguistics, humanities, social sciences, or technical fields.
• Prior experience with transcription, annotation, evaluation, or research workflows.
• Interest in AI, language models, or applied research environments.

Additional Role Details

• Structured, goal-oriented project environment with clear tooling, guidelines, and support.
• Hands-on exposure to real-world AI research and evaluation workflows.

Key skills/competency

• Korean Fluency
• English Fluency
• Audio Transcription
• Data Annotation
• Language Model Evaluation
• Linguistic Analysis
• Critical Thinking
• Quality Assurance (QA)
• Technical Documentation
• Project Collaboration