Consultant Specialist

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist. Responsibilities Migrate and re-engineer existing services from on-premises data centers to Cloud (GCP), Design and develop scalable data pipelines: architect and implement end-to-end data workflows using Apache Airflow for orchestration, integrating multiple data sources and sinks across cloud and on-prem environments. Build and optimize data models in Google BigQuery for performance and costefficiency, including partitioning, clustering, and materialized views to support analytics and reporting use cases. Design robust ETL/ELT pipelines to extract, transform, and load structured and semistructured data, ensuring data quality, reliability, and availability. Leverage GCP services like Cloud Storage, Pub/Sub, Dataflow, and Cloud Functions to build resilient, eventdriven data workflows. Implement CI/CD for data pipelines using tools like Cloud Composer (managed Airflow), Git, and Terraform, ensuring automated deployment and versioning of workflows. Ensure proper data classification, access control, and audit logging within GCP, adhering to data governance and compliance standards. Build proactive monitoring for pipeline health and data quality using tools such as Stackdriver (Cloud Monitoring) and custom Airflow alerting mechanisms. Work closely with data analysts, data scientists, and business teams to understand requirements and deliver highquality, timely data products. Qualifications Overall working experience of more than 5 years primarily in DWH/ETL background. 3+ years handson experience with Python. 3+ years handson experience with GCP BigQuery. 3+ years handson experience with Apache Airflow / Cloud Composer. 3+ years handson experience with PL/SQL scripting. 5+ years handson experience with ETL tools such as DataStage, Informatica, or Prophecy. 2+ years handson experience with realtime data processing using Pub/Sub, Kafka broker, or NiFi. GCP Associate Cloud Engineer certification is an added advantage with AI experience. Youll achieve more when you join HSBC. HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website. Issued by HSBC Software Development India We are currently seeking an experienced professional to join our team in the role of Consultant Specialist. Responsibilities Migrate and re-engineer existing services from on-premises data centers to Cloud (GCP), Design and develop scalable data pipelines: architect and implement end-to-end data workflows using Apache Airflow for orchestration, integrating multiple data sources and sinks across cloud and on-prem environments. Build and optimize data models in Google BigQuery for performance and costefficiency, including partitioning, clustering, and materialized views to support analytics and reporting use cases. Design robust ETL/ELT pipelines to extract, transform, and load structured and semistructured data, ensuring data quality, reliability, and availability. Leverage GCP services like Cloud Storage, Pub/Sub, Dataflow, and Cloud Functions to build resilient, eventdriven data workflows. Implement CI/CD for data pipelines using tools like Cloud Composer (managed Airflow), Git, and Terraform, ensuring automated deployment and versioning of workflows. Ensure proper data classification, access control, and audit logging within GCP, adhering to data governance and compliance standards. Build proactive monitoring for pipeline health and data quality using tools such as Stackdriver (Cloud Monitoring) and custom Airflow alerting mechanisms. Work closely with data analysts, data scientists, and business teams to understand requirements and deliver highquality, timely data products. Qualifications Overall working experience of more than 5 years primarily in DWH/ETL background. 3+ years handson experience with Python. 3+ years handson experience with GCP BigQuery. 3+ years handson experience with Apache Airflow / Cloud Composer. 3+ years handson experience with PL/SQL scripting. 5+ years handson experience with ETL tools such as DataStage, Informatica, or Prophecy. 2+ years handson experience with realtime data processing using Pub/Sub, Kafka broker, or NiFi. GCP Associate Cloud Engineer certification is an added advantage with AI experience. Youll achieve more when you join HSBC. HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive an