Principal Data Engineer
@ ATPCO

Herndon, Virginia, United States
$153,000
On Site
Intern
Posted 23 days ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXX XXXXXXX***** @atpco.com
Recommended after applying

Job Details

Company Overview

ATPCO is the foundation of flight shopping, providing pricing and retailing data, tools, and services to over 500 airlines, global distribution systems, sales channels, and technology companies. For more than 55 years, ATPCO has been a reliable partner in air travel, ensuring that solutions work seamlessly across diverse technologies.

Role Overview

As a Principal Data Engineer at ATPCO, you will build and optimize data pipelines, manage data storage and processing systems, and ensure the availability, scalability, and reliability of our data platform. In this role, you will collaborate with data scientists, software engineers, and business stakeholders to transform complex data requirements into high-quality solutions.

Responsibilities

  • Translate business and ML/AI use cases into scalable data architectures.
  • Design, develop, and maintain efficient data pipelines and ETL processes.
  • Build and optimize data storage systems using AWS services like Amazon Redshift, AWS Glue, AWS EMR, AWS S3, and AWS Lambda.
  • Implement real-time data streaming architectures with AWS Kinesis or Apache Kafka.
  • Perform data profiling, cleansing, and transformation tasks.
  • Ensure security and compliance through AWS security measures.
  • Develop data architectures based on Data Mesh principles.
  • Provide mentorship to junior data engineers and review their work.

Qualifications

  • Strong programming skills in Python, Java, or Scala.
  • Experience designing and building large-scale data processing systems.
  • Deep understanding of data modeling, SQL, and database management.
  • Keen knowledge of Data Mesh principles within the AWS ecosystem.
  • Experience with real-time streaming and AWS cloud services.
  • [Bonus] Experience with scalable machine learning pipelines and MLOps frameworks.
  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.

Key skills/competency

Principal Data Engineer, data pipelines, AWS, ETL, Data Mesh, data security, real-time streaming, Python, scalability, mentorship

Apply without a personalized resume

How to Get Hired at ATPCO

🎯 Tips for Getting Hired

  • Customize your resume: Tailor your skills to ATPCO's data challenges.
  • Research ATPCO: Study their industry impact and AWS usage.
  • Highlight AWS expertise: Emphasize experience with AWS services.
  • Prepare for technical interviews: Review data architecture and ETL processes.
  • Show leadership: Demonstrate mentorship and collaboration skills.

📝 Interview Preparation Advice

Technical Preparation

Review AWS service documentation and best practices.
Practice designing scalable ETL pipelines and data models.
Study real-time streaming frameworks like Kafka and Kinesis.
Refresh Python, Java, or Scala coding challenges.

Behavioral Questions

Describe a challenging data project you led.
Explain your approach to cross-team collaboration.
Share a situation improving data pipeline efficiency.
Discuss mentorship experiences with junior engineers.

Frequently Asked Questions