Software Engineer II

Overview

The AI Frameworks team at Microsoft builds the foundational software that powers advanced machine learning across all major Microsoft products—including Windows, Office, Bing, and more. Our work bridges the latest AI models and diverse hardware, enabling seamless AI experiences from supercomputers to mobile devices.

This role targets infrastructure engineers. As a member of the Engineering Systems team, you will focus on cloud security, infrastructure as code, monitoring large distributed systems, CI/CD, build, and the deployment of internal tooling. You will provide workflow improvements and stability to enable the AI Frameworks team to do more, faster, and more efficiently across an array of hardware and programming languages.

This is a technical role: it requires hands-on design and development skills. We seek candidates with hands-on experience building and maintaining infrastructure for large-scale C++ and/or Python projects ideally hosted in Github or Azure DevOps.

We foster a collaborative, growth-oriented environment where engineers are empowered to innovate and share knowledge. An entrepreneurial approach and ability to take initiative and move fast are essential.

Responsibilities

As a Software Engineer II, the common tasks of the job would include, but not be limited to:

• Design and develop highly usable, scalable application capabilities, enhancing existing features to meet evolving developer and security needs.
• Perform Software Development in C++, Python, YAML, Powershell, and other relevant languages to support AI infrastructure.
• Build and debug production-grade code in distributed systems
• Automate security practices in production and development environments.
• Own deployment, quality and operation of AI systems, including automated testing, CI/CD pipelines, deployment, and monitoring with DevOps practices.
• Ensure high reliability and performance of applications and services through intelligent monitoring, alerting, and proactive failover strategies.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications

• Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
• A technical background and solid foundation in software engineering principles and architecture design
• An intellectual curiosity and passion about learning new technologies
• Previous cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
• Experience in cloud security and Azure
• Experience with Azure DevOps or github
• Experience with CI/CD systems
• Experience with CMake

Key skills/competency

• C++
• Python
• Cloud Security
• CI/CD
• Distributed Systems
• Infrastructure as Code
• Machine Learning
• Azure DevOps
• Monitoring
• Software Engineering