Sr. Data & Analytics Engineer – Job Description

Summary:

This role is ideal for an experienced data engineer who can build scalable data solutions, integrate complex datasets, improve data quality, and enable analytics-driven business decisions.

Location: Durham, NC (Hybrid )

Role Overview:

We are looking for a Senior Data & Analytics Engineer to design, build, and maintain scalable data pipelines and analytics solutions. This role focuses on integrating data from multiple sources, improving data quality, and creating reliable datasets that support business insights and decision-making.

Key Responsibilities:

Build and maintain data pipelines using SQL, Python, Spark, and Databricks.
Integrate data from multiple internal and external sources.
Design and develop scalable data models for analytics, reporting, segmentation, and business use cases.
Perform data transformation, validation, and quality checks.
Troubleshoot data integration, modeling, and data quality issues.
Optimize data processing and improve pipeline performance.
Collaborate with business teams, IT teams, analytics teams, and external partners.
Document data processes, standards, and best practices.
Support analytics and reporting teams with clean, trusted datasets.

Required Skills:

Bachelor’s degree in Computer Science, Data Science, or related field.
6+ years of experience in Data Engineering, Analytics Engineering, or Data Platform roles.
Strong proficiency in:
SQL
Python
Apache Spark / PySpark
Databricks
ETL/Data pipeline development
Experience working with complex, evolving, or undocumented data sources.
Strong troubleshooting and problem-solving skills.
Excellent communication skills with technical and business stakeholders.

Preferred Skills:

Experience with Healthcare or Pharmaceutical data.
Knowledge of HCP, patient, NPI, claims, or marketing data.
Experience with:
Salesforce Marketing Cloud
Data warehousing concepts
Parquet and Hive Metastore
Workflow orchestration tools
Python data libraries

About the role