Principal Applied Scientist

Overview

We are seeking an Applied Scientist / AI Architect with strong hands-on experience in building and optimizing large language models (LLMs), agentic AI systems, and end-to-end model training workflows. This role is ideal for scientists with a solid applied background who can translate state-of-the-art research into real-world impact. A research-oriented mindset with publications in top AI/ML venues is highly preferred but not strictly required. Our mission is to innovate in collaborative office area by exploring LLM and agentic AI. You will collaborate closely with product, engineering, and research teams to ship intelligent, reliable, and innovative AI capabilities at scale.

Responsibilities

• Design and implement advanced LLM-based architectures and agentic systems for real-world product scenarios.
• Translate research breakthroughs into production-ready algorithms, contributing to core capabilities such as reasoning, planning, long-term memory, code-gen based design.
• Monitor and improve model performance post-deployment through data-driven iteration and error analysis.
• Collaborate across teams to deliver robust, scalable models aligned with product objectives and user value.
• Contribute to the organization’s scientific direction by identifying research opportunities that drive long-term differentiation.

Qualifications

• M.S. or Ph.D. in Computer Science, Machine Learning, or a related field, or equivalent practical experience.
• 5+ years of experience in applied machine learning, with a focus on LLMs, agent systems, or reinforcement learning.
• Strong hands-on experience with prompt engineering, context engineering, retrieval-augmented generation (RAG), tool use, planning agents, and long-context modeling, etc.
• Familiarity with model training pipelines using PyTorch, TensorFlow, JAX, or similar frameworks, evaluation strategies, and model deployment best practices.
• Solid publication record (e.g., NeurIPS, ICLR, ACL, ICML, EMNLP) is a plus, but emphasis is placed on practical contributions.
• Strong coding and debugging skills, and comfort working in cross-functional, agile environments.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Key skills/competency

• Large Language Models (LLMs)
• Agentic AI Systems
• Prompt Engineering
• Retrieval-Augmented Generation (RAG)
• PyTorch
• TensorFlow
• JAX
• Model Deployment
• Reasoning & Planning
• Cross-functional Collaboration