Source description
About the role
About The Opportunity : Operating in the IT Consulting & Cloud Services sector, this role sits within a fast-moving cloud data engineering practice that delivers end-to-end analytics, ETL/ELT and real-time streaming solutions for enterprise clients. The position is fully on-site in India and focuses on designing, building and operating scalable data platforms on Google Cloud Platform (GCP) to support reporting, ML pipelines and analytics at scale. Role & Responsibilities : - Design and implement scalable, secure ETL/ELT data pipelines on GCP using Dataflow, Pub/Sub and BigQuery for batch and streaming use cases. - Develop and productionize Python-based data services and orchestration workflows using Apache Airflow/Composer; automate deployment with Terraform and CI/CD pipelines. - Define data models, ingestion patterns and partitioning/cluster strategies in BigQuery to optimise cost and query performance. - Implement data reliability, monitoring and alerting using Cloud Monitoring/Stackdriver, logging best practices and SLIs/SLOs to maintain uptime and data quality. - Collaborate with data scientists, analysts and stakeholders to translate business requirements into robust data solutions and performant datasets. - Apply cloud security and IAM best practices; steward data governance, lineage and access controls across GCP resources. Skills & Qualifications Must-Have : - BigQuery - Cloud Dataflow - Cloud Pub/Sub - Cloud Storage - Apache Airflow - Terraform - Python - SQL Preferred : - Dataproc - Kubernetes - Looker Qualifications : - Proven hands-on experience implementing production data pipelines and data modelling on GCP (on-site in India). - Familiarity with cloud security, IAM, cost optimisation and data governance for enterprise workloads. Benefits & Culture Highlights : - Career growth within a specialist cloud-data practice and exposure to large enterprise analytics programs. - Structured mentorship, technical training and opportunities to earn/maintain GCP certifications. - Collaborative, delivery-focused culture with emphasis on engineering quality, observability and client impact.
More at Zorba Consulting