Data Analyst I

About the Data Analyst I Role

Keystone Recruitment is seeking a detail-oriented Data Analyst I to support large-scale data curation and evaluation initiatives specifically for advanced generative AI systems. This pivotal role focuses on enhancing model quality across critical dimensions, including visual fidelity, prompt adherence, identity preservation, naturalness, and text generation within images.

You will engage closely with both engineering and research teams, managing data labeling workflows, maintaining high-volume data pipelines, auditing annotations, and analyzing model outputs to pinpoint quality discrepancies. This is an onsite position requiring active, hands-on collaboration with technical teams in Menlo Park, CA.

Key Responsibilities

Data Curation & Labeling Operations

• Manage end-to-end data labeling workflows.
• Enqueue datasets for labeling and maintain efficient labeling interfaces.
• Extract structured labels for modeling teams.
• Manually annotate training data as needed.
• Audit and correct human-labeled data to ensure accuracy.

Data Engineering & Pipelines

• Maintain and optimize large-scale data processing pipelines, handling billions of images.
• Support data sourcing and content understanding using sophisticated ML models.
• Leverage Large Language Models (LLMs) to clean, annotate, and evaluate data effectively.
• Assist in building and improving efficient ETL (Extract, Transform, Load) workflows.

Data Governance

• Maintain a comprehensive dataset portfolio with proper access controls.
• Ensure strict compliance with data retention and privacy standards.
• Support robust governance and documentation practices across data assets.

Analysis & Model Evaluation

• Identify critical model quality gaps using structured evaluation protocols.
• Collaborate directly with engineers to summarize findings and propose actionable improvements.
• Mine and prepare new datasets for iterative model training cycles.
• Scale validated evaluation frameworks across various product teams.

Required Qualifications

• Associate’s degree or equivalent training in Computer Science, Engineering, Physics, Bioinformatics, or another STEM field.
• Basic proficiency in Python and SQL.
• Foundational understanding of computer vision and generative AI models.
• Experience with data ETL workflows or pipelines.
• Familiarity using LLMs for data labeling or evaluation tasks.
• Strong attention to detail and robust analytical thinking abilities.

Preferred Qualifications

• Prior industry experience in software development, quality assurance (QA), or research.
• Exposure to human-computer interaction or Machine Learning evaluation work.
• Experience working in large-scale technology environments.
• Strong written and verbal communication skills.

Work Environment

• Onsite collaboration with engineering teams located in Menlo Park, CA.
• A fast-paced, research-driven environment focused on innovation.
• A high-impact role directly supporting the development of next-generation AI systems.

Key skills/competency

• Data Curation
• Data Labeling
• Generative AI
• Machine Learning
• Data Pipelines
• ETL Workflows
• Python
• SQL
• Computer Vision
• Model Evaluation