Data Engineer

@ CGG

About Data Engineer

Viridien is an advanced technology, digital and Earth data company that pushes the boundaries of science for a more prosperous and sustainable future. The Data Engineer plays a crucial role in developing our software solution for complex data transformation challenges. This role involves building orchestration systems, ensuring resilience and scalability, and creating a modular framework that supports data transformation modules.

Key Responsibilities

• Develop data platform infrastructure including orchestration, processing, and system interactions.
• Create a flexible framework for modular data transformation logic.
• Build robust, metadata-driven data pipelines addressing performance, monitoring, and maintainability.
• Communicate architectural design clearly using diagrams and documentation.
• Implement systems deployment and integration with client data stores.

Qualifications

Candidates must have experience in designing and maintaining data transformation systems with secure and performant coding in Python and SQL. Experience with orchestrators (especially Airflow), RDBMS (PostgreSQL, Oracle) and additional exposure to NoSQL or vector databases is essential. Experience in data modelling, warehousing, version control (git, Gitlab), and CI/CD is required. A willingness to learn and adapt is critical. Preferred qualifications include DevOps/DataOps practices, Kubernetes, Azure data technologies, RESTful APIs, and familiarity with web frameworks.

Team & Work Environment

The Data Hub team comprises scientists and developers in an open, collaborative, and fun environment. Based in hub locations (Crawley or Llandudno), you will work alongside experts in data engineering, machine learning, and software development. A hybrid work arrangement is offered, with remote working considered.

Benefits & Hiring Process

The role offers an attractive bonus scheme, flexible holidays, contributory pension plan, private medical & dental care, and various discount schemes. The hiring process is respectful, inclusive, and transparent with a focus on personalized feedback at later interview stages and provision for applying candidates who need reasonable adjustments.

Key skills/competency

Data transformation, orchestration, Python, SQL, Airflow, ETL, data pipelines, CI/CD, Docker, Kubernetes