Job Overview
Job TitleSenior Data Engineer
Job TypeFull Time
Offered Salary$140,000
LocationBengaluru, Karnataka, India
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Senior Data Engineer
News Corp is seeking a Senior Data Engineer with excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, SQL, and GCP Services. The ideal candidate will operate in an agile environment and possess a keen attention to detail while understanding the larger data warehouse.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud, using tools like Cloud Composer (Airflow), Dataproc, and BigQuery.
- Collaborate with cross-functional teams to define data architecture and data warehouse requirements.
- Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools.
- Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications.
- Deliver production-quality, modular, reproducible code in Python and SQL.
- Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Skills & Competencies
- A minimum of 4.5+ years of working experience as a hands-on data engineer is required.
- Advanced degree in Computer Science, Data Engineering, Data Analytics, or equivalent discipline.
- Strong programming experience with Python, SQL, ETL, and efficiently querying big datasets using SQL.
- Prior experience with CircleCI CI/CD, Terraform, and Github version control is a must.
- Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance.
- Ability to implement data governance practices, including data quality, security, and compliance, in line with organizational standards.
- Domain knowledge in News, Media & Communications is an added advantage.
Our Tech Stack
- Google Cloud Platform (GCP)
- BigQuery
- DataProc
- Python
- PySpark
- SQL
- Composer / Airflow
- Terraform
- CircleCI
- CI/CD
- Github
- Jira
- Confluence
Key Skills/Competency
- Senior Data Engineer
- GCP BigQuery
- ETL/ELT
- Python
- SQL
- Data Warehousing
- Data Pipelines
- Cloud Composer
- Airflow
- CI/CD
How to Get Hired at News Corp
- Tailor your resume: Highlight your 4.5+ years of data engineering experience, GCP, BigQuery, Python, SQL, and CI/CD skills.
- Showcase ETL/ELT expertise: Emphasize your experience in designing, building, and maintaining data pipelines.
- Demonstrate agile proficiency: Mention your ability to work in an agile environment and attention to detail.
- Prepare for technical questions: Be ready to discuss BigQuery optimization, SQL querying, and Python coding.
- Highlight relevant experience: If you have News, Media, or Communications domain knowledge, make it prominent.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What are the key technical skills required for the Senior Data Engineer role at News Corp?
02Does News Corp require specific experience in cloud platforms for this Senior Data Engineer position?
03What is the expected level of experience for a Senior Data Engineer at News Corp?
04How can I demonstrate my understanding of data governance for the Senior Data Engineer role at News Corp?
05Is domain knowledge in the News, Media, or Communications industry required for this Senior Data Engineer job?
06What is the work arrangement for the Senior Data Engineer position at News Corp?
07What are the core responsibilities of a Senior Data Engineer at News Corp?
Explore similar opportunities that match your background