Senior Software Engineer, ML Networking
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
About the Role: Senior Software Engineer, ML Networking
Our team at Google is dedicated to advancing the Google Cloud GPU roadmap, specifically focusing on integrating shared capabilities to enhance ML fungibility. We are actively developing and implementing key programs such as A4X+ and A5, scheduled for General Availability in 2026.
This is an opportunity to be an innovator, not just maintain the status quo. We're delivering novel capabilities including GPU RDMA, ML Networking for Virtual Machines (VMs) and bare metal systems, monitoring, and packet telemetry. Our rapidly growing team offers you a unique chance to shape the future of Google's network, directly influencing the infrastructure that powers everything at Google.
Responsibilities
- Understand capabilities provided by series of ConnectX (CX) Network Interface Cards (NICs).
- Design features that seamlessly integrate GPU-to-GPU communication capabilities into the unique Google Cloud Infrastructure.
- Bring your designs to life by meticulously coding and implementing the features that enable efficient and reliable GPU-to-GPU communication on the new VM families.
- Deliver virtual ML networking infrastructure enabling ML workloads to run in Google Cloud Platform (GCP).
- Enable fast GPU RDMA networking for VM and Baremetal by exposing the NICs.
Minimum Qualifications
- Bachelor's degree or equivalent practical experience.
- 5 years of experience with one or more general purpose programming languages including but not limited to: Java, C/C++, Python, or Go.
Preferred Qualifications
- Experience with software architecture, software engineering, networking protocols, network virtualization, or networking.
Key skills/competency
- ML Networking
- GPU RDMA
- Network Virtualization
- ConnectX NICs
- Google Cloud Platform (GCP)
- Software Architecture
- C/C++/Python/Go/Java
- Distributed Systems
- Packet Telemetry
- Infrastructure Design
How to Get Hired at Google
- Research Google's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your experience to highlight ML networking, GPU, cloud infrastructure, and relevant programming skills for Google.
- Showcase problem-solving: Prepare to discuss complex technical challenges, your design decisions, and implementation strategies during interviews.
- Master technical fundamentals: Strengthen your knowledge in data structures, algorithms, networking protocols, and systems design, crucial for Google's rigorous process.
- Understand Google Cloud: Familiarize yourself with GCP services, especially compute and networking, to demonstrate alignment with the Senior Software Engineer, ML Networking role.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background