Data Engineer

About The Company

Trantor is a leading technology solutions provider committed to delivering innovative and scalable data-driven solutions to a diverse range of industries. With a focus on leveraging cloud-native architectures, Trantor specializes in building robust data platforms, advanced analytics, and digital transformation strategies. Our mission is to empower organizations with the tools and expertise necessary to harness the full potential of their data, driving informed decision-making and sustained growth. At Trantor, we foster a collaborative and inclusive work environment that encourages continuous learning, innovation, and excellence.

About The Role

We are seeking a highly skilled and motivated Data Engineer with extensive experience in AWS data services to join our dynamic data platform team. The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud-native data pipelines, orchestrating complex workflows, and executing large-scale data migrations. This role requires a deep understanding of AWS cloud services, data architecture, and best practices in data security and governance. The successful candidate will play a critical role in transforming legacy data systems into modern, efficient, and secure data platforms that support analytics and business intelligence initiatives. You will collaborate closely with cross-functional teams including data scientists, analysts, and software engineers to deliver high-quality data solutions that meet organizational needs.

Qualifications

• Minimum of 5+ years of professional experience in Data Engineering or Data Platform development.
• Proven expertise in AWS cloud services including AWS Glue, AWS S3, AWS Lambda, and AWS Redshift.
• Hands-on experience with data workflow orchestration tools such as Apache Airflow or AWS Step Functions.
• Strong proficiency in Python and SQL for building scalable data pipelines.
• Experience with data migrations from legacy systems and RDBMS platforms like MySQL, SQL Server, or Oracle to AWS data solutions.
• Solid understanding of ETL/ELT processes, data partitioning, and distributed data processing frameworks.
• Experience working with version control systems such as GitLab or Bitbucket.
• Excellent debugging, analytical, and problem-solving skills.
• Basic knowledge of Object-Oriented Programming concepts.

Responsibilities

• Design, develop, and implement scalable ETL/ELT data pipelines utilizing AWS Glue, Lambda, and S3 to facilitate data ingestion, transformation, and storage.
• Build and optimize high-performance data ingestion frameworks capable of processing large datasets efficiently.
• Develop data pipelines supporting data warehousing and analytics platforms, including AWS Redshift.
• Implement and manage data storage strategies leveraging AWS S3 data lakes for cost-effective and scalable data management.
• Develop and maintain data workflow orchestration frameworks using tools such as Apache Airflow or AWS Step Functions to automate data processes.
• Automate complex workflows involving data ingestion, transformation, validation, and loading to ensure seamless data operations.
• Lead data migration initiatives from legacy data warehouses and RDBMS systems to AWS cloud platforms with minimal downtime.
• Design scalable migration frameworks capable of handling large datasets securely and efficiently.
• Integrate diverse data sources from enterprise applications and external systems to create unified data platforms.
• Implement data security best practices by managing access controls through AWS IAM and Lake Formation, ensuring data privacy and compliance.
• Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost efficiency.
• Establish logging, monitoring, and alerting mechanisms to proactively identify and resolve data pipeline issues.

Benefits

At Trantor, we value our employees and offer a comprehensive benefits package designed to support your professional growth and well-being. Our benefits include competitive salary packages, health insurance coverage, and retirement plans. We also provide opportunities for continuous learning through training programs, certifications, and industry conferences. Employees have access to flexible work arrangements to promote work-life balance. Additionally, we foster a collaborative and innovative work environment that encourages knowledge sharing and career development. Trantor is committed to recognizing and rewarding excellence in performance, ensuring our team members are motivated and engaged.

Equal Opportunity

Trantor is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, disability, or any other protected characteristic. We believe that a diverse workforce enhances our ability to innovate and serve our clients effectively. All qualified applicants will receive consideration for employment without regard to any protected status. We are dedicated to fostering a workplace where everyone feels valued, respected, and empowered to contribute their best.

Key skills/competency

• Data Engineering
• AWS Glue
• AWS S3
• AWS Lambda
• AWS Redshift
• Apache Airflow
• AWS Step Functions
• Python
• SQL
• ETL/ELT