Data Engineer - Data Platforms

@ IBM

Introduction

At IBM, you will join one of our Consulting Client Innovation Centers to provide technical and industry expertise to public and private sector clients across the globe. Our centers deliver local technical skills and innovative solutions to drive technology adoption.

Your Role And Responsibilities

As a Data Engineer - Data Platforms, you will harness data to uncover insightful patterns and stories. You will be involved in data gathering, storage, and both batch and real-time processing. By collaborating with diverse teams, you help select the best data management systems and identify critical data for analysis. You will tackle database integration challenges and manage complex, unstructured data sets.

Responsibilities

• Implement and validate predictive models using statistical and machine learning techniques.
• Create and maintain statistical models focused on big data.
• Design and implement enterprise search applications using Elasticsearch and Splunk.
• Work in an agile, collaborative environment with scientists, engineers, and analysts.
• Develop programs to cleanse and integrate data efficiently.

Preferred Education

Master's Degree

Technical And Professional Expertise

• Develop or convert databases from Hadoop to GCP including tables, views, procedures, and functions.
• Implement data replication mechanisms such as CDC and bulk or file data transfers.
• Expose data as APIs and contribute to modernization roadmaps.
• Lead discovery workshops to analyze application dependencies and non-functional requirements.

Preferred Technical And Professional Experience

You should demonstrate teamwork and excellent communication skills to articulate analytical solutions to diverse audiences.

Key skills/competency

• Data Engineering
• Big Data
• Machine Learning
• Database Integration
• Data Replication
• Agile
• API Development
• Predictive Modeling
• Elasticsearch
• Cloud Platforms