Product Manager II
Microsoft
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
Product Manager II at Microsoft
The Azure High-Performance Computing/Artificial Intelligence (HPC/AI) team is seeking talented individuals to help drive networking for the largest AI training supercomputers in the world. As a Product Manager II in AI Supercomputing networking, you will collaborate with AI compute product managers, frontier AI model developers, datacenter design and operations experts, and networking vendors. This role involves helping the largest AI supercomputing customers train the most advanced models that power widely used consumer and enterprise software services. This opportunity will accelerate your career growth, develop deep business acumen, hone practical AI supercomputing skills, and make you adept at working across multiple teams and stakeholders for Microsoft Azure, the world's foremost AI Cloud. This is a flexible work opportunity for which a candidate can partially work from home.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we foster a growth mindset, innovate to empower others, and collaborate to achieve shared goals. Our daily actions are built on values of respect, integrity, and accountability to create an inclusive culture where everyone can thrive.
Responsibilities
- Drive, track, and publish success criteria for backend networking of ultra-large-scale AI supercomputers. Your primary objective, shared with colleagues and partner teams, is to drive maximum operational uptime and AI workload throughput of some of the largest supercomputers on the planet.
- Identify leading and/or unique points of failure affecting your primary goal and associated KPIs, and drive remediations and roadmap changes to address those issues.
- Work across and build trust among a V-team of supercomputing product groups, datacenter site operators, quality control specialists, vendors, business leaders, and customers to achieve your objectives.
Qualifications
Required/Minimum Qualifications:
- Bachelor's Degree AND 2+ years experience in product/service/project/program management or software development OR equivalent experience.
Other Requirements:
- Ability to meet Microsoft, customer, and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Additional Or Preferred Qualifications
- Bachelor's Degree AND 5+ years of experience in product/service/project/program management or software development OR equivalent experience.
- 5+ years experience in operating production supercomputers.
- 5+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
- Familiarity with RoCE v2, InfiniBand, UCX, MPI, NCCL, RCCL, and distributed memory compute workloads.
- Ability to work overlapping hours with East Coast teams (EST).
Key skills/competency
- Product Management
- AI Supercomputing
- Networking Infrastructure
- Operational Uptime
- KPI Tracking
- Roadmap Management
- Stakeholder Collaboration
- Distributed Computing
- Azure Cloud
- Problem Solving
How to Get Hired at Microsoft
- Research Microsoft's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Highlight product management, AI, HPC, and networking skills relevant to the Product Manager II role.
- Showcase impact: Quantify your achievements in product metrics, operational improvements, and cross-functional project leadership.
- Prepare for technical depth: Understand RoCE v2, InfiniBand, UCX, MPI, NCCL, RCCL, and distributed compute workloads.
- Practice behavioral questions: Emphasize collaboration, problem-solving, strategic thinking, and a growth mindset during your interview for this Microsoft role.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background