Data Engineer - Data Platforms Google
IBM
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Introduction
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You will work with leading companies across industries, helping them shape their hybrid cloud and AI journeys using robust IBM technology and Red Hat support. IBM Consulting encourages you to challenge the norm, explore new ideas, and create innovative solutions for real impact while growing your career with a culture of empathy and continuous learning.
Your Role And Responsibilities
As a Data Engineer - Data Platforms Google, you will design, build, and maintain data engineering solutions on Google's Cloud ecosystem. Your primary responsibilities include:
- Design and develop batch and real-time data pipelines using Google Cloud services.
- Utilize Google Cloud Storage, BigQuery, DataProc, DataFlow, PubSub, and Big Table for solutions.
- Manage data platform scheduling with Google Cloud Scheduler and Cloud Composer (Airflow).
- Implement seamless data migration solutions using Google services.
- Optimize data storage and retrieval using BigQuery, Big Table, and Cloud Spanner.
Preferred Education
Master's Degree
Required Technical And Professional Expertise
- Expertise in designing, building, and maintaining Google Cloud data solutions.
- Experience with batch and real-time data pipeline development.
- Proficiency in Google Cloud Storage, BigQuery, and related Google services.
- Knowledge in managing data platforms with scheduling tools such as Cloud Scheduler and Airflow.
- Understanding of data layer design for efficient storage and retrieval.
Preferred Technical And Professional Experience
- Exposure to open source technologies like Apache Airflow, dbt, Spark/Python or Spark/Scala.
- Experience with data migration solutions using Google services.
- Familiarity with Cloud Composer for scheduling and managing data platforms.
Key skills/competency
- Google Cloud
- Data Pipelines
- Data Migration
- BigQuery
- DataFlow
- DataProc
- Airflow
- Cloud Composer
- Batch Processing
- Real-time Processing
How to Get Hired at IBM
- Customize your resume: Highlight Google Cloud expertise and project successes.
- Research IBM Consulting: Understand their hybrid cloud and AI focus.
- Showcase technical skills: Emphasize experience with DataProc, DataFlow and BigQuery.
- Prepare for interviews: Review data pipeline design and migration scenarios.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background