AI Research Engineer

@ Handshake

About Handshake AI

Handshake is building the career network for the AI economy. Our three-sided marketplace connects 18 million students and alumni, 1,500+ academic institutions across the U.S. and Europe, and 1 million employers to power how the next generation explores careers, builds skills, and gets hired.

Handshake AI is a human data labeling business leveraging the scale of the largest early career network. We partner with the world’s leading AI research labs to create a new generation of human data products. Our team is composed of experts ranging from PhDs in physics to undergrads fluent in LLMs.

About The Role

As an AI Research Engineer at Handshake AI, you will design and implement post-training systems and methodologies in partnership with research scientists and domain experts. You will build infrastructure to support large-scale model training, specialized data processing, and benchmark evaluation. Your work will involve developing robust frameworks to verify data quality, creating next-generation LLM benchmarks, and optimizing software and hardware performance to accelerate post-training experimentation.

• Design and implement post-training systems.
• Build infrastructure for model training and data processing.
• Develop frameworks for dataset quality verification.
• Create benchmarks for advanced model evaluation.
• Collaborate with research scientists and domain experts.

Desired Capabilities

• Strong Python programming with clean, efficient, scalable code.
• Experience with large-scale systems, model post-training, and data processing.
• Deep familiarity with PyTorch and post-training techniques like RLHF and constitutional AI.
• Background in applied machine learning, model evaluation, or data quality assessment.
• Clear communication skills and collaborative mindset.

Extra Credit

• Optimizing deep learning models for performance.
• Interest in the societal and ethical impacts of AI.
• Contributions to open-source ML infrastructure or tools.

Perks

• Ownership: Equity in a fast-growing company.
• Financial Wellness: 401(k) match, competitive compensation, financial coaching.
• Family Support: Paid parental leave, fertility benefits, parental coaching.
• Wellbeing: Comprehensive medical, dental, vision and mental health support with a wellness stipend.
• Growth: $2,000 learning stipend and ongoing development.
• Work Environment: Remote setup with SF office perks like free lunch and gym access.
• Time Off: Flexible PTO with holidays and office-wide breaks.
• Connection: Team outings and referral bonuses.

Key skills/competency

• Python
• PyTorch
• Post-training
• Data Processing
• Benchmark Evaluation
• RLHF
• Constitutional AI
• Machine Learning
• Infrastructure
• Collaboration