Data Engineer - Google Data Platforms
IBM
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Introduction
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries to shape their hybrid cloud and AI journeys. With support from strategic partners, IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. Curiosity fuels success at IBM Consulting, where you are encouraged to challenge norms, explore new ideas, and create innovative solutions.
Your Role And Responsibilities
As a Data Engineer specializing in Google's data platforms, you will design, build, and maintain data engineering solutions on Google's Cloud ecosystem by utilizing a range of Google services.
- Design Data Pipelines: Develop batch and real-time pipelines for Data Warehouse and Datalake using Google DataProc, DataFlow, PubSub, BigQuery, and Big Table.
- Develop Data Engineering Solutions: Utilize Google Cloud Storage, BigTable, DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python.
- Manage Data Platforms: Schedule and manage data platform operations with Google Cloud Scheduler and Cloud Composer (Airflow).
- Implement Data Migration: Build and implement data migration solutions ensuring seamless data transfer between systems.
- Optimize Data Layer: Design and optimize data storage and retrieval using BigQuery, Big Table, and Cloud Spanner.
Preferred Education
Master's Degree
Required Technical And Professional Expertise
Expertise with Google Cloud Ecosystem including DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB. Experience in developing batch and real-time data pipelines using Apache Airflow, dbt, Spark/Python or Spark/Scala, and proficiency with Google Cloud Storage and related services.
Preferred Technical And Professional Experience
Experience with open-source technologies, data migration solutions, and Cloud Composer for ensuring efficient data pipeline operations.
Key skills/competency
- Google Cloud
- Data Pipelines
- BigQuery
- DataFlow
- Apache Beam
- Airflow
- Data Migration
- Spark
- Python
- Data Warehouse
How to Get Hired at IBM
- Research IBM Consulting's culture: Understand their cloud and AI transformation projects.
- Tailor your resume: Highlight Google Cloud and data pipeline expertise.
- Showcase project experience: Detail your role in data migration and optimization.
- Prepare for technical interviews: Review Google Cloud services and open-source tools.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background