GCP Data Engineer

As an IT Consultant & Cloud Services professional joining our team in India, you will be a part of a dynamic cloud data engineering practice focused on providing cutting-edge analytics, ETL/ELT, and real-time streaming solutions for our enterprise clients. Your primary responsibility will be to design, build, and maintain scalable data platforms on Google Cloud Platform (GCP) to enable efficient reporting, ML pipelines, and analytics at scale. Key Responsibilities: - Design and deploy secure and scalable ETL/ELT data pipelines on GCP utilizing tools such as Dataflow, Pub/Sub, and BigQuery for both batch and streaming data processing. - Develop Python-based data services and orchestration workflows using Apache Airflow/Composer, ensuring automation of deployment through Terraform and CI/CD pipelines. - Define data models, ingestion patterns, and partitioning strategies in BigQuery to enhance cost efficiency and query performance. - Implement data reliability measures, monitoring, and alerting using Cloud Monitoring/Stackdriver, adhering to logging best practices and SLIs/SLOs to ensure high uptime and data quality. - Collaborate closely with data scientists, analysts, and stakeholders to transform business requirements into robust data solutions and high-performance datasets. - Uphold cloud security best practices, manage IAM policies, and enforce data governance, lineage, and access controls across GCP resources. Qualifications Required: - Hands-on experience in building production data pipelines and data modeling on GCP, preferably within an on-site setup in India. - Proficiency in cloud security, IAM, cost optimization, and data governance principles related to enterprise workloads. In addition to the exciting challenges and responsibilities, you will enjoy the following benefits and cultural highlights: - Opportunities for career advancement within our specialized cloud-data practice and exposure to significant enterprise analytics projects. - Access to structured mentorship, technical training programs, and possibilities to acquire and maintain GCP certifications. - Engage in a collaborative work environment with a strong focus on engineering excellence, observability, and delivering impactful solutions. Your expertise in BigQuery, Cloud Dataflow, Cloud Pub/Sub, Cloud Storage, Apache Airflow, Terraform, Python, SQL, and familiarity with Dataproc, Kubernetes, and Looker will be invaluable assets in excelling in this role. As an IT Consultant & Cloud Services professional joining our team in India, you will be a part of a dynamic cloud data engineering practice focused on providing cutting-edge analytics, ETL/ELT, and real-time streaming solutions for our enterprise clients. Your primary responsibility will be to design, build, and maintain scalable data platforms on Google Cloud Platform (GCP) to enable efficient reporting, ML pipelines, and analytics at scale. Key Responsibilities: - Design and deploy secure and scalable ETL/ELT data pipelines on GCP utilizing tools such as Dataflow, Pub/Sub, and BigQuery for both batch and streaming data processing. - Develop Python-based data services and orchestration workflows using Apache Airflow/Composer, ensuring automation of deployment through Terraform and CI/CD pipelines. - Define data models, ingestion patterns, and partitioning strategies in BigQuery to enhance cost efficiency and query performance. - Implement data reliability measures, monitoring, and alerting using Cloud Monitoring/Stackdriver, adhering to logging best practices and SLIs/SLOs to ensure high uptime and data quality. - Collaborate closely with data scientists, analysts, and stakeholders to transform business requirements into robust data solutions and high-performance datasets. - Uphold cloud security best practices, manage IAM policies, and enforce data governance, lineage, and access controls across GCP resources. Qualifications Required: - Hands-on experience in building production data pipelines and data modeling on GCP, preferably within an on-site setup in India. - Proficiency in cloud security, IAM, cost optimization, and data governance principles related to enterprise workloads. In addition to the exciting challenges and responsibilities, you will enjoy the following benefits and cultural highlights: - Opportunities for career advancement within our specialized cloud-data practice and exposure to significant enterprise analytics projects. - Access to structured mentorship, technical training programs, and possibilities to acquire and maintain GCP certifications. - Engage in a collaborative work environment with a strong focus on engineering excellence, observability, and delivering impactful solutions. Your expertise in BigQuery, Cloud Dataflow, Cloud Pub/Sub, Cloud Storage, Apache Airflow, Terraform, Python, SQL, and familiarity with Dataproc, Kubernetes, and Looker will be invaluable assets in excelling in this role.