Source description
About the role
Responsibilities: - Design and build scalable data pipelines on GCP. - Develop batch and real-time data processing workflows using Dataflow. - Process large datasets using Dataproc (Spark/Hadoop). - Store and analyze data in BigQuery. - Ingest data from multiple sources such as Cloud Storage, Pub/Sub, APIs, and databases. - Optimize SQL queries and improve pipeline performance. - Monitor, troubleshoot, and maintain data pipelines. - Collaborate with data analysts, data scientists, and application teams. Must have skills: - GCP, Dataflow, BigQuery, Dataproc. .
More at Elabs Infotech