Source description
About the role
We are seeking a skilled professional to design, build, and maintain scalable data pipelines and data platforms on the Google Cloud Platform (GCP) . This role involves working with large datasets, enabling analytics and reporting use cases, and collaborating with data analysts, data scientists, and cloud teams to deliver reliable, high-performance data solutions. Join us in Pune, a vibrant city known for its educational institutions and burgeoning tech industry, offering a perfect blend of professional growth and quality of life. Key Responsibilities Design and develop end-to-end data pipelines on Google Cloud Platform Build, optimize, and maintain ETL/ELT workflows using GCP services Develop and manage data solutions using BigQuery Implement batch and streaming data processing using Dataflow / Apache Beam Work with messaging systems such as Pub/Sub for real-time data ingestion Ensure data quality, reliability, and performance optimization Collaborate with stakeholders to understand data requirements and use cases Implement data security, governance, and access controls Monitor data pipelines and troubleshoot production issues Document data architecture and operational processes Required Skills & Qualifications Technical Skills Strong experience with Google Cloud Platform (GCP) Hands-on expertise in: BigQuery Cloud Storage Dataflow Pub/Sub Strong SQL skills and experience handling large datasets Proficiency in Python and/or Java for data engineering tasks Experience with batch and streaming data processing Working knowledge of data warehousing concepts Understanding of data modeling and schema design .
More at Artech