Source description
About the role
Extensive industry experience in designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.Expertise in GCP Data Products for storage, processing, analytics, and machine learning, enabling enterprises to manage, analyse, and derive insights from data at scale e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer.Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google CloudProven experience and knowledge of automation and CI/CD Jenkins, GitHub & Spinnaker. Best practice coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong working experience with operational data stores, data warehouse, big data technologies and data lakes Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS. Strong experience working with (Real Time streaming), such as Kafka technologies.Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts. Good understating of cloud storage, networking, and resource provisioning Extensive industry experience in designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.Expertise in GCP Data Products for storage, processing, analytics, and machine learning, enabling enterprises to manage, analyse, and derive insights from data at scale e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer.Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google CloudProven experience and knowledge of automation and CI/CD Jenkins, GitHub & Spinnaker. Best practice coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong working experience with operational data stores, data warehouse, big data technologies and data lakes Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS. Strong experience working with (Real Time streaming), such as Kafka technologies.Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts. Good understating of cloud storage, networking, and resource provisioning
More at EduRun Group
Related open roles
Senior/Lead Java Developer(with React & AWS)
Hyderabad
EduRun Group HiringWindows Engineer | Windows, Linux, Azure, AWS | Hyderabad
Hyderabad
Informatica MDM Administrator
Hyderabad
Sr.Data Engineer (with Databricks)
Hyderabad
Sr. Data Engineer (with Azure Databricks) (Hyderabad)
Hyderabad
Sr. Python Developer (with API)
Hyderabad