Padmi

Sr.GCP Data Engineer/Lead

BangalorePosted 1 month ago
Software engineeringSeniorFull Time; Regular
Apply at EduRun Group

Opens the source posting on shine.com

Source description

About the role

View original

Extensive industry experience in designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.Expertise in GCP Data Products for storage, processing, analytics, and machine learning, enabling enterprises to manage, analyse, and derive insights from data at scale e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer.Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google CloudProven experience and knowledge of automation and CI/CD Jenkins, GitHub & Spinnaker. Best practice coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong working experience with operational data stores, data warehouse, big data technologies and data lakes Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS. Strong experience working with (Real Time streaming), such as Kafka technologies.Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts. Good understating of cloud storage, networking, and resource provisioning Extensive industry experience in designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.Expertise in GCP Data Products for storage, processing, analytics, and machine learning, enabling enterprises to manage, analyse, and derive insights from data at scale e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer.Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google CloudProven experience and knowledge of automation and CI/CD Jenkins, GitHub & Spinnaker. Best practice coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong working experience with operational data stores, data warehouse, big data technologies and data lakes Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS. Strong experience working with (Real Time streaming), such as Kafka technologies.Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts. Good understating of cloud storage, networking, and resource provisioning

One address, no account. We’ll tell you when matching roles go live.

More at EduRun Group

Related open roles

View all roles