Data Scientist, Evaluation

Summary: Data Scientist, Evaluation at Apple

Are you passionate about driving product impact through precise measurement and evaluation for products and services used by hundreds of millions globally? The Data Science and Insights team within Apple's evaluation organization is dedicated to guiding product development and decisions through principled evaluation and rigorous data usage.

In this role, you will collaborate with various engineering teams to enhance search quality and guide feature development with data, contributing to exceptional search experiences across Apple devices and dozens of languages.

Key Responsibilities

• Research and develop innovative evaluation methods to significantly improve the quality of Siri’s user-facing products.
• Partner with evaluation/experimentation engineering teams to integrate methodological advancements into Siri's daily engineering practices.
• Work extensively with large, complex data sets to solve challenging, non-routine analysis problems.
• Apply advanced analytical methods, conducting comprehensive analysis from data gathering and requirements to processing, ongoing work, and presentations.
• Build and iteratively prototype analysis pipelines to deliver scalable insights.
• Develop deep expertise in Siri Search data structures and metrics, advocating for necessary changes to support product development.
• Collaborate closely with Siri search engineering teams on core machine learning algorithms and systems that power Siri's understanding and responsiveness.

Minimum Qualifications

• Proven experience in data science, machine learning, and analytics, including statistical data analysis and A/B testing.
• Ability to clearly articulate and translate business questions into statistical analyses using available data.
• Strong programming skills in data-querying (SQL and/or Spark) and scripting languages (e.g., Python, R, or Scala) for data processing and development.
• 5 years of relevant work experience.
• B.S. in Machine Learning, Computer Science, Statistics, Operations Research, or related fields.

Preferred Qualifications

• Hands-on experience with online A/B testing platforms, including experiment design, analysis, and interpretation.
• Practical experience with on-device logging and metrics development.
• Experience with large language models (LLMs) and their application in evaluation and product improvement.
• Ph.D. in Machine Learning, Computer Science, Statistics, Operations Research, or related fields.

Pay & Benefits at Apple

Apple offers a comprehensive total compensation package where base pay is determined within a range of $147,400 to $272,100, dependent on skills, qualifications, experience, and location. Employees have the opportunity to participate in Apple’s discretionary employee stock programs, including restricted stock unit awards and a discounted Employee Stock Purchase Plan.

Benefits include comprehensive medical and dental coverage, retirement benefits, discounted products and services, and reimbursement for career-advancing formal education. This role may also be eligible for discretionary bonuses, commission payments, and relocation assistance.

Apple is an equal opportunity employer committed to inclusion and diversity, promoting equal opportunity for all applicants.

Key skills/competency

• Data Science
• Machine Learning
• A/B Testing
• Statistical Analysis
• SQL
• Python
• Spark
• Experiment Design
• LLM Evaluation
• Product Evaluation