Lead Data Engineer
@ AND Digital

Hybrid
£80,000
Hybrid
Full Time
Posted 1 day ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXXXX XXXXXXXX***** @and.digital
Recommended after applying

Job Details

Overview

The Lead Data Engineer role at Lead Data Engineer involves spearheading the migration of a large-scale on-prem Oracle data warehouse to Google Cloud Platform BigQuery. You will work with Analytics and Data Engineers to build and maintain modern analytical data models and ETL workflows.

Key Responsibilities

  • Collaborate with team members to migrate data models from Oracle to BigQuery using DBT and ELT pipelines
  • Develop, optimise, and maintain analytical data models following a Medallion architecture
  • Translate complex Oracle table structures into scalable GCP data models
  • Utilize ingestion pipelines leveraging Kafka (batch) and Dataflow for reliable data availability
  • Ensure data quality and governance standards throughout the migration process
  • Contribute to phased migration plans with key milestones
  • Participate in code freezes and timely deliverables aligning with project timelines

Required Skills and Experience

  • Strong proficiency in SQL and data modeling best practices
  • Hands-on experience with GCP BigQuery and cloud-based ETL/ELT workflows
  • Practical knowledge of DBT for data transformation and modeling
  • Experience with data ingestion from batch/streaming sources like Kafka and Dataflow
  • Experience with data platform migrations from Oracle to cloud platforms
  • Able to work effectively in an agile and collaborative team environment

Joining AND Digital

At AND Digital, people come first. This role is part of a culture that values autonomy, diversity, and a strong team dynamic. If you are ready to contribute to significant digital transformations and work in a diverse, fast-moving environment, this opportunity may be right for you.

Key Skills/Competency

  • SQL
  • Data Modeling
  • GCP BigQuery
  • ETL/ELT
  • DBT
  • Kafka
  • Dataflow
  • Oracle Migration
  • Analytics
  • Agile
Apply without a personalized resume

How to Get Hired at AND Digital

🎯 Tips for Getting Hired

  • Customize your resume: Highlight migration and cloud skills.
  • Research AND Digital: Understand their digital agility and culture.
  • Emphasize technical skills: Focus on SQL, DBT, and GCP expertise.
  • Prepare examples: Showcase your migration project successes.

📝 Interview Preparation Advice

Technical Preparation

Review GCP BigQuery documentation.
Practice SQL and data modeling challenges.
Familiarize with DBT pipelines.
Test Kafka and Dataflow integrations.

Behavioral Questions

Describe teamwork under tight deadlines.
Explain conflict resolution in agile environments.
Discuss handling project challenges.
Share adaptation to new technologies.

Frequently Asked Questions