Data Engineer Data Platforms

@ IBM

Introduction

In this role at IBM, you will work in one of our Consulting Client Innovation Centers (Delivery Centers), delivering deep technical and industry expertise to a wide range of public and private sector clients worldwide. You will harness the power of data to unveil captivating stories and intricate patterns.

Your Role And Responsibilities

As a Data Engineer Data Platforms at IBM, you will contribute to data gathering, storage, and both batch and real-time processing. Working closely with diverse teams, you will decide on data management systems and identify crucial data required for insightful analysis. Your responsibilities include tackling database integration challenges and untangling complex, unstructured data sets.

Key Responsibilities

• Implement and validate predictive and statistical models focusing on big data.
• Design and implement enterprise search applications using Elasticsearch and Splunk.
• Collaborate in an Agile environment with data scientists, engineers, and consultants.
• Develop programs to cleanse, integrate data, and evaluate modeling results.
• Migrate databases (e.g., Hadoop to GCP), including objects like tables, views, procedures, etc.
• Implement data replication mechanisms (CDC, file transfer, bulk data transfer).
• Expose data as APIs, participate in modernization roadmaps, and lead discovery workshops.
• Analyze non-functional requirements (security, HA, performance) and prepare effort estimates.

Preferred Education and Experience

A Master's Degree is preferred along with strong teamwork and excellent communication skills to interact with both technical and non-technical audiences.

Key skills/competency

• Data Engineering
• Big Data
• Database Migration
• API Development
• Predictive Modeling
• Agile
• Hadoop
• GCP
• Statistical Modeling
• Team Collaboration