GCP Data Engineer / Consultant Specialist
HSBC · Pune Division, Maharashtra, India
- On site
- Full-time
- $120,000 / year
- Pune Division, Maharashtra, India
Job highlights
- Design and deliver data pipelines on GCP.
- Gather requirements and build scalable data solutions.
- Utilize Apache Beam on Dataflow for data processing.
- Manage GCP storage and orchestrate workflows.
- Lead SRE practices for reliability and automation.
About the role
GCP Data Engineer / Consultant Specialist
Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
Department: CTO Data - Data Tech IWPB & UK - Data Tech IWPB
In This Role, You Will
- Design and deliver batch and streaming ETL/ELT pipelines to ingest data from multiple sources into GCP.
- Gather requirements with stakeholders and translate business needs into scalable data solutions.
- Build Apache Beam pipelines on GCP Dataflow for extraction, transformation, and analytical preparation.
- Integrate data from databases, APIs, and flat files while enforcing data quality, consistency, and governance.
- Manage and optimise GCP storage/warehouse layers (BigQuery, Cloud Storage) for analytics and reporting.
- Orchestrate and automate workflows using Airflow/Cloud Composer; reduce manual operations through automation.
- Implement observability (monitoring/alerting), troubleshoot bottlenecks, and ensure SLA/SLO adherence.
- Lead SRE practices: reliability strategy, incident response, post-mortems, documentation, security/compliance, and continuous improvement.
To be successful in this role, you should meet the following requirements:
- Bachelor’s degree in Computer Science/IT (or equivalent experience).
- Proven ETL/ELT experience: data modelling, data warehousing concepts, and strong SQL.
- Strong GCP experience (certification preferred), especially BigQuery/Cloud Storage/Dataflow.
- Big data batch + streaming expertise (e.g., Kafka, Spark/Flink, Hadoop/Hive/HBase, dbt).
- Proficiency in Java and/or Python for data engineering and data manipulation.
- Proven SRE/DevOps experience: architecture, reliability, automation, and operational excellence.
- Incident management capability: on-call/response, RCA, and post-mortem execution.
- Strong communication and problem-solving; experience with AI/LLM (preferably financial services).
You’ll achieve more when you join HSBC. www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website. Issued by – HSBC Software Development India
Key skills/competency
- GCP Data Engineering
- ETL/ELT Design and Delivery
- Apache Beam on Dataflow
- BigQuery and Cloud Storage Management
- Airflow/Cloud Composer Orchestration
- SRE Practices
- Data Integration
- SQL Proficiency
- Python/Java Development
- AI/LLM Experience
Skills & topics
- GCP
- Data Engineer
- ETL
- ELT
- BigQuery
- Dataflow
- Cloud Storage
- Airflow
- Python
- Java
- SQL
- SRE
- DevOps
- Apache Beam
- Kafka
- Spark
- Flink
- dbt
- Data Modeling
- Data Warehousing
- AI
- LLM
- Financial Services
How to get hired
- Tailor your resume: Highlight GCP, ETL/ELT, SQL, Python/Java, and SRE experience.
- Showcase GCP expertise: Mention specific services like BigQuery, Dataflow, and Cloud Storage.
- Demonstrate SRE/DevOps skills: Emphasize automation, reliability, incident management, and CI/CD.
- Prepare for technical questions: Be ready to discuss data modeling, warehousing, and big data concepts.
- Understand HSBC's values: Align your communication with their focus on culture and development.
Technical preparation
Master GCP services: BigQuery, Dataflow, Cloud Storage.,Practice SQL for complex data modeling.,Build ETL/ELT pipelines with Python or Java.,Understand SRE principles: automation, reliability.
Behavioral questions
Describe a complex data challenge you solved.,How do you ensure data quality and governance?,Share an experience leading SRE practices.,How do you handle incident response and post-mortems?
Frequently asked questions
- What specific GCP services are most critical for this GCP Data Engineer role at HSBC?
- For this GCP Data Engineer position at HSBC, strong experience with BigQuery, Cloud Storage, and Dataflow is essential. Proficiency in these core GCP services will be key to designing, delivering, and managing data solutions.
- How important is SRE/DevOps experience for a GCP Data Engineer at HSBC?
- Proven SRE/DevOps experience is highly important for this GCP Data Engineer role at HSBC. The job description specifically calls for expertise in architecture, reliability, automation, operational excellence, incident management, and continuous improvement, indicating a strong focus on site reliability engineering principles.
- What programming languages are preferred for this GCP Data Engineer position?
- Proficiency in Java and/or Python is required for this GCP Data Engineer role at HSBC. These languages are needed for data engineering tasks, data manipulation, and building pipelines within the GCP environment.
- Does HSBC require a specific GCP certification for this role?
- While a GCP certification is preferred, it is not strictly required for this GCP Data Engineer role at HSBC. Demonstrable strong GCP experience, particularly with BigQuery, Cloud Storage, and Dataflow, is considered essential.
- What are the key data warehousing concepts expected for this GCP Data Engineer role?
- For this GCP Data Engineer role at HSBC, you should have a solid understanding of data modelling and general data warehousing concepts. This knowledge is crucial for designing efficient and scalable data solutions within the GCP ecosystem.
- Is experience with AI/LLM relevant for this GCP Data Engineer role at HSBC?
- Yes, experience with AI/LLM is mentioned as a desired skill for this GCP Data Engineer position, especially within the financial services context. While not a primary focus, it could be an advantage, particularly in understanding how data engineering supports these technologies.
- What are the primary responsibilities of an ETL/ELT engineer at HSBC?
- As an ETL/ELT engineer at HSBC, your primary responsibilities will involve designing and delivering pipelines to ingest data into GCP, gathering stakeholder requirements, building data processing pipelines (e.g., Apache Beam on Dataflow), managing GCP storage, and automating workflows using tools like Airflow/Cloud Composer.
- How does HSBC approach continuous improvement for their data engineering teams?
- HSBC emphasizes continuous improvement through leading SRE practices, which include reliability strategy, incident response, post-mortems, documentation, security/compliance, and overall operational excellence for their data engineering initiatives.