PitchMeAI
SoTalent

Senior Data Engineer

SoTalent · Wisconsin, United States

  • On site
  • Full-time
  • Wisconsin, United States
Tailored resumekeyword-matched to this role.
Hiring managerwe find who's hiring.
Intro emaildrafted to reach them directly.

About the role

Job Title : Senior Data Engineer

Location : Whitefish Bay, WI, US

Job Type : Full Time


Our Client is Looking a talented Senior Data Engineer – Research & Data Platforms to support the development of enterprise-grade data products that enable data-driven innovation in research and development. This role plays a critical part in building scalable data pipelines and ensuring high-quality data availability across complex, multi-source environments.


Key Responsibilities

Data Engineering & Pipeline Development

  • Design, develop, and maintain scalable, high-performance data pipelines
  • Build robust data workflows to support enterprise data products and analytics use cases
  • Ensure efficient data ingestion, transformation, and delivery across platforms

Data Integration & Management

  • Integrate data from diverse internal and external sources while ensuring consistency and reliability
  • Implement best practices for data governance, quality, and security
  • Maintain structured and accessible data models aligned with business needs

Performance & Optimization

  • Optimize data processing pipelines for scalability, performance, and cost efficiency
  • Monitor pipeline health and resolve performance bottlenecks
  • Ensure reliability and availability of data systems

Collaboration & Stakeholder Engagement

  • Partner with data scientists, analysts, and business stakeholders to understand data requirements
  • Support development of analytics, machine learning, and reporting solutions
  • Work cross-functionally to drive data platform improvements

Documentation & Continuous Improvement

  • Maintain comprehensive documentation for data pipelines, architectures, and workflows
  • Stay updated with the latest data engineering tools, cloud technologies, and best practices
  • Identify opportunities for automation, efficiency improvements, and innovation


What We’re Looking For

Technical Expertise

  • Strong experience in data engineering, pipeline development, and large-scale data processing
  • Expertise in Databricks and modern data lakehouse architectures
  • Proficiency in SQL and programming languages such as Python, Java, or Scala
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP)
  • Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)
  • Familiarity with ETL tools and data integration frameworks

Analytics & Data Management

  • Strong understanding of data modeling, governance, and quality frameworks
  • Experience working with large-scale, multi-source datasets
  • Exposure to analytics, reporting, or machine learning workflows

Collaboration & Communication

  • Excellent problem-solving and analytical skills
  • Strong communication and ability to work in cross-functional teams
  • Ability to translate technical concepts into business-relevant insights


Qualifications

Required:

  • Bachelor’s or Master’s degree in Computer Science, IT, or related field
  • 5–7 years of experience in data engineering or related roles
  • Strong experience with Databricks and SQL-based data systems


Preferred:

  • Experience with data visualization tools (e.g., Tableau, Power BI)
  • Understanding of machine learning concepts and data science workflows
  • Experience in regulated industries (e.g., healthcare, pharmaceuticals)
  • Familiarity with data privacy and compliance standards