DevOps Engineer

Someone who can help client to build scalable, reliable, and secure Data analytic solutions. Technologies you will get to work with: - 1.Azure Databricks 2.Azure Data factory 3.Azure DevOps 4.Spark with Python Scala and Airflow scheduling. What You will Do:- As a DevOps engineer you will work as an integral part of our Cloud DevOps team for a Retail client. The ideal candidate has extensive DevOps knowledge and experience and has previously been part of a DevOps team running an analytical ecosystem in modern cloud-based big data systems in a fast-paced, agile environment. The Specific Focus for The DevOps Engineer Is On Processing Engine Development As Well As The Design, Development, Automation And Optimisation Of Its Usage In Client s Analytic Ecosystem: Liaise in a geographically dispersed team by co-location with our client across globe. Participate in a continuous delivery pipeline to fully automate deployment of the highly available cloud platform that supports multiple teams/projects Build tools for deployment, monitoring and operations. Troubleshoot and resolve issues in our development, test and production environments Strong working experience in CI/CD processes Work with platform architects on software and system optimisations, helping to identify and remove potential performance bottlenecks Stay up-to-date on relevant technologies, plug into user groups, understand trends and opportunities to ensure we are using the best possible techniques and tools Understand, implement, and automate security controls, governance processes, and compliance validation Design, manage and maintain tools to automate operational processes Required Technical and Professional Expertise: Professional programming experience and hands-on experience in building modern data platforms/pipelines. Programming languages: Scala, Java, Python is plus Frameworks: Spark, Hadoop, Hive, Kafka Databases: Azure Synapse, NoSQL, Strong in Relational databases Data pipelining: Azure Data factory, ELT Scheduling: Airflow Cloud: Azure Stack, Azure DevOps, Azure Databricks Experience in Kubernetes, Docker, and Virtualisation DevOps: Experience in Agile, CI/CD Previous experience gained in mid-size/large, international companies