Senior Machine Learning Engineer, ML Systems Ev...

@ Apple

Job Description

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger.

It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. Our belief that we can make something wonderful and share it with the world drives us to create products that change lives for the better.

As part of Apple Intelligence, the Siri team is at the forefront of the next revolution in machine learning and Generative AI. We are dedicated to creating groundbreaking conversational assistant technologies, building upon our legacy of intelligent assistant solutions that already assist millions of users worldwide.

Does the opportunity to play a part in building groundbreaking technology for large-scale systems and artificial intelligence excite you? Join the ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AI/ML products, that will delight and inspire millions of people!

Position Overview

We are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI to join our dynamic team. Our goal is to deliver offline evaluation insights that drive model development and improvements while upholding the privacy standards that Apple is known for. The ideal candidate will play a pivotal role in the evaluation and enhancement of our products.

You will collaborate closely with cross-functional teams to lead the creation and evolution of high-quality datasets for evaluation of state-of-the-art models. The focus is on leveraging large language models (LLMs) to automatically evaluate the impact of model changes on user experience and assess the quality of conversations with a digital assistant.

Additionally, you will harness generative AI to create adversarial scenarios that anticipate future user behaviors, enabling robust evaluation. These datasets will shape the future of Apple products, ensuring that improvements translate into tangible benefits for our users.

Minimum Qualifications

• 7+ years of professional work experience in machine learning.
• Experience with natural language products and technologies.
• Excellent programming skills in Python.

Preferred Qualifications

• Good knowledge of Conversational AI.
• Critical thinking and communication skills.
• Understanding of ML-based product lifecycle.