Staff Software Engineer - Ingestion @ Databricks
Your Application Journey
Email Hiring Manager
Job Details
Overview
At Databricks, our passion is enabling data teams to solve the world's toughest problems by building the best data and AI infrastructure platform. The Staff Software Engineer - Ingestion role is critical to ingesting data into the Lakehouse and is a strategic investment for the company.
The Role
As part of the Lakeflow Connect team, you will build ready-to-use, point-and-click connectors for various sources including enterprise applications, databases, cloud storage, message queues, and local files. You will engage in hands-on engineering and lead critical projects across products such as Dashboards, Notebooks, SQL, and AI.
Responsibilities
- Solve real business needs at large scale through innovative software engineering.
- Deliver a scalable, available, and fault-tolerant engine processing hundreds of TB daily.
- Conduct low-level systems debugging, performance measurement, and optimization on large production clusters.
- Design architecture, influence product roadmap, and take full project ownership.
- Mentor team members and lead sprint planning and technical reviews.
What We Look For
- 15+ years of industry experience in building and supporting large-scale distributed systems.
- Expertise in Database replication, backup, and transaction recovery from major vendors.
- Strong foundation in algorithms, data structures, and system design.
- Experience in driving company initiatives towards customer satisfaction.
- Ability to break down complex problems and de-risk them via prototyping and validation.
About Databricks
Databricks is the data and AI company trusted by over 10,000 organizations worldwide. Headquartered in San Francisco, Databricks is founded by the original creators of Lakehouse, Apache Spark™, Delta Lake, and MLflow.
Benefits & Commitment
Databricks offers comprehensive benefits and fosters a diverse and inclusive culture. Check the specific benefits for your region at Databricks Benefits.
Key skills/competency
- Distributed Systems
- Database Internals
- Data Ingestion
- Performance Optimization
- System Debugging
- Architecture Design
- Mentorship
- Technical Leadership
- Incremental Data Capture
- Log Parsing
How to Get Hired at Databricks
🎯 Tips for Getting Hired
- Customize Your Resume: Tailor it for Databricks and ingestion roles.
- Highlight Key Projects: Showcase distributed systems and database projects.
- Network on LinkedIn: Connect with current Databricks staff.
- Prepare for Technical Interviews: Practice low-level systems and debugging questions.