Lead Data Engineer
@ INDI Staffing Services

Hybrid
$150,000
Hybrid
Full Time
Posted 23 days ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXXXX XXXXXXXXX***** @indi.com
Recommended after applying

Job Details

Overview of the Role

At INDI Staffing Services, we are passionate about empowering individuals and businesses worldwide. The Lead Data Engineer is a core contributor to internal Data Platforms, responsible for building scalable, resilient pipelines supporting Business Operations, Analytics, and cutting-edge AI/ML initiatives. This role involves designing, implementing, and optimizing data pipelines using a range of Big Data and cloud-native technologies while providing technical leadership and ensuring architectural consistency.

Key Responsibilities

  • Provide technical leadership and mentor fellow data engineers.
  • Lead design reviews, enforce coding standards, and guide architecture.
  • Collaborate with senior stakeholders to align technical work with business goals.
  • Serve as a technical contact for cross-team collaborations and project planning.
  • Integrate AI-powered tools and support AI/GenAI projects.
  • Drive adoption of testing, CI/CD, and observability best practices.
  • Design and maintain batch and streaming data pipelines.
  • Ingest data from various sources and implement robust transformation logic using Python, PySpark, SQL, and Java.
  • Ensure data integrity, lineage, and performance across all data layers.

Requirements

  • 6+ years of experience in enterprise-scale data engineering.
  • Proven leadership in technical project management and mentorship.
  • Expertise in SQL, Python, PySpark or Java, and Hadoop ecosystem technologies.
  • Strong background in data modeling, transformation, and data warehouse architectures.
  • Experience in pipeline development that meets strict service levels.
  • Understanding of API integration and performance optimization.
  • Advanced English proficiency.

Additional Skills Preferred

  • Experience with Apache NiFi and Apache Airflow.
  • Expertise in containerized environments and developer tooling.
  • Knowledge in AI/ML platform support and generative AI pipeline development.
  • Contributions to internal technological innovations in data workflows.

What to Expect

Competitive compensation in USD or your preferred local currency, paid leave including parental leave, vacation, and national holidays. Work in a dynamic, innovative, multicultural environment alongside the global top 1% of talent, with ample mentorship and career development opportunities.

Key Skills/Competency

  • Data Pipelines
  • Cloud-Native
  • Big Data
  • Python
  • SQL
  • AI/ML
  • Leadership
  • Architecture
  • PySpark
  • Hadoop
Apply without a personalized resume

How to Get Hired at INDI Staffing Services

🎯 Tips for Getting Hired

  • Research INDI Staffing Services culture: Review mission, values, and recent updates online.
  • Customize your resume: Highlight data pipelines and leadership experience.
  • Practice technical skills: Brush up on SQL, Python, and Hadoop technologies.
  • Prepare for interviews: Focus on technical and behavioral questions.

📝 Interview Preparation Advice

Technical Preparation

Review complex data pipeline architectures.
Practice SQL, Python, PySpark exercises.
Study cloud-native big data tools.
Learn API integration and data transformations.

Behavioral Questions

Describe your team leadership experience.
Explain handling difficult project decisions.
Share mentoring examples with junior engineers.
Discuss collaboration in cross-functional projects.

Frequently Asked Questions