Data Analyst I

About the Role of Data Analyst I

Keystone Recruitment is seeking a detail-oriented Data Analyst I to support large-scale data curation and evaluation initiatives crucial for advanced generative AI systems. This pivotal role focuses on enhancing model quality across critical dimensions, including visual fidelity, prompt adherence, identity preservation, naturalness, and text generation within images.

You will collaborate closely with engineers and research teams, managing data labeling workflows, maintaining high-volume data pipelines, auditing annotations, and analyzing model outputs to pinpoint quality gaps. This is an onsite role requiring hands-on collaboration with technical teams in Menlo Park, CA.

Key Responsibilities

Data Curation & Labeling Operations

• Manage end-to-end data labeling workflows.
• Enqueue datasets for labeling and maintain labeling interfaces.
• Extract structured labels for modeling teams.
• Manually annotate training data when required.
• Audit and correct human-labeled data.

Data Engineering & Pipelines

• Maintain and optimize large-scale data processing pipelines, handling billions of images.
• Support data sourcing and content understanding utilizing ML models.
• Leverage Large Language Models (LLMs) to clean, annotate, and evaluate data.
• Assist in building efficient ETL (Extract, Transform, Load) workflows.

Data Governance

• Maintain a comprehensive dataset portfolio with proper access controls.
• Ensure compliance with stringent data retention and privacy standards.
• Support robust governance and documentation practices.

Analysis & Model Evaluation

• Identify model quality gaps through structured evaluation protocols.
• Collaborate with engineers to summarize findings and recommend improvements.
• Mine and prepare new datasets for iterative model training.
• Scale validated evaluation frameworks across various product teams.

Required Qualifications

• Associate’s degree or equivalent training in Computer Science, Engineering, Physics, Bioinformatics, or another STEM field.
• Basic knowledge of Python and SQL.
• Foundational understanding of computer vision and generative AI models.
• Experience with data ETL workflows or pipelines.
• Familiarity using LLMs for data labeling or evaluation tasks.
• Strong attention to detail and analytical thinking.

Preferred Qualifications

• Prior industry experience in software development, QA, or research.
• Exposure to human-computer interaction or ML evaluation work.
• Experience working in large-scale technology environments.
• Strong written and verbal communication skills.

Work Environment

• Onsite collaboration with engineering teams in Menlo Park, CA.
• Fast-paced, research-driven environment.
• High-impact role supporting next-generation AI systems.

Key skills/competency

• Data Curation
• Data Labeling
• Generative AI
• Machine Learning Models
• ETL Workflows
• Python
• SQL
• Computer Vision
• Model Evaluation
• Data Pipelines