Staff Software Engineer - Ingestion
@ Databricks

Bengaluru, Karnataka, India
$250,000
On Site
Full Time
Posted 23 days ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXX XXXXXX***** @databricks.com
Recommended after applying

Job Details

Overview

At Databricks, our passion is enabling data teams to solve the world's toughest problems by building the best data and AI infrastructure platform. The Staff Software Engineer - Ingestion role is critical to ingesting data into the Lakehouse and is a strategic investment for the company.

The Role

As part of the Lakeflow Connect team, you will build ready-to-use, point-and-click connectors for various sources including enterprise applications, databases, cloud storage, message queues, and local files. You will engage in hands-on engineering and lead critical projects across products such as Dashboards, Notebooks, SQL, and AI.

Responsibilities

  • Solve real business needs at large scale through innovative software engineering.
  • Deliver a scalable, available, and fault-tolerant engine processing hundreds of TB daily.
  • Conduct low-level systems debugging, performance measurement, and optimization on large production clusters.
  • Design architecture, influence product roadmap, and take full project ownership.
  • Mentor team members and lead sprint planning and technical reviews.

What We Look For

  • 15+ years of industry experience in building and supporting large-scale distributed systems.
  • Expertise in Database replication, backup, and transaction recovery from major vendors.
  • Strong foundation in algorithms, data structures, and system design.
  • Experience in driving company initiatives towards customer satisfaction.
  • Ability to break down complex problems and de-risk them via prototyping and validation.

About Databricks

Databricks is the data and AI company trusted by over 10,000 organizations worldwide. Headquartered in San Francisco, Databricks is founded by the original creators of Lakehouse, Apache Spark™, Delta Lake, and MLflow.

Benefits & Commitment

Databricks offers comprehensive benefits and fosters a diverse and inclusive culture. Check the specific benefits for your region at Databricks Benefits.

Key skills/competency

  • Distributed Systems
  • Database Internals
  • Data Ingestion
  • Performance Optimization
  • System Debugging
  • Architecture Design
  • Mentorship
  • Technical Leadership
  • Incremental Data Capture
  • Log Parsing
Apply without a personalized resume

How to Get Hired at Databricks

🎯 Tips for Getting Hired

  • Customize Your Resume: Tailor it for Databricks and ingestion roles.
  • Highlight Key Projects: Showcase distributed systems and database projects.
  • Network on LinkedIn: Connect with current Databricks staff.
  • Prepare for Technical Interviews: Practice low-level systems and debugging questions.

📝 Interview Preparation Advice

Technical Preparation

Review distributed systems architecture fundamentals.
Study database internals and replication techniques.
Practice low-level debugging and performance tuning.
Revisit log parsing and incremental capture methodologies.

Behavioral Questions

Describe a time you led a technical project.
Explain how you handle complex system breakdowns.
Discuss mentoring experiences in technical teams.
Share conflict resolution approaches in projects.

Frequently Asked Questions