Principal Software Engineering Architect

Principal Software Engineering Architect - Azure Core

Are you a technology leader with a passion for big data, large language models (LLMs), and agentic platforms? The Azure Resource Graph (ARG) team is seeking a highly motivated Principal Software Engineering Architect - Azure Core to help lead our expansion into the next generation of big data and LLM/agentic platform services.

ARG is the Index of the Azure Control Plane, enabling customers of all sizes to govern, analyze, manage, and explore their Azure environments at scale. Performance and scalability are core to our DNA. Now, we are extending our platform vision beyond search and governance to incorporate LLM-driven intelligence, agentic workflows, and advanced data platforms that will transform how customers interact with and manage Azure.

We are building a unique set of capabilities to shorten that cycle and increase Azure adoption. You will be immersed in many exciting, cutting-edge technologies with immense opportunity for growth and immediate business impact. If you are passionate about building scalable distributed platforms, advancing the LLM/agentic space, and driving the next wave of intelligent cloud management, this is your opportunity to shape the future. Come help us take Azure Resource Graph to the next level!

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design scalable architectures for distributed systems that integrate machine learning and intelligent agents.
• Partner across Azure to build platform capabilities that accelerate AI adoption and unlock new customer experiences.
• Define and lead the strategy for ARG’s evolution into LLM and agentic services.
• Guide engineering teams in building high-performance, future-ready services with immediate customer and business impact.
• Achieve quality results with laser customer focus.
• Build distributed micro-services in the area of proprietary columnar databases, replication, batching, agentic, indexing, change tracking, insights, and in defining graph models.
• Focus on end-to-end services, development, and deployment.

Required Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications

• Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 5+ years of experience in architecting large scale distributed systems, running a service in one of the large-scale clouds like Microsoft Azure (Azure), or similar, providing technical leadership, raising the technical bar, maintaining data and results-driven culture while closely working with cross function teams, for the same connected mission, and building true cloud-scale services.
• 4+ years of exposure to the internals of Big Data Systems like Spark, Kubernetes, Structured Streaming etc.
• 2+ years of experience problem-solving skills in the space of AI, large datasets, Spark, Ray or other computing technologies.
• 2+ years of exposure to the internals of databases, stores.
• 1+ year of exposure with LLMs/RAG.

Key skills/competency

• Principal Software Engineering Architect
• Big Data
• Large Language Models (LLMs)
• Agentic Platforms
• Distributed Systems
• Machine Learning
• Azure
• Cloud Scale Services
• Data Platforms
• Software Architecture