Data Engineer

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location : Gurugram Mode Of Work : Hybrid Notice Period : Immediate Joiners Experience : 8-11 yrs Type Of Hire : Contract to Hire Primary Skills :- The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required. Key Responsibilities include: • Designing, developing and implementing solutions to customers organisational problems; • Providing high quality service delivery on engagements; • Designing and developing data reconciliation metadata driven data processing frameworks; Responsibilities and Duties Key Skills/Experience: • Working experience and strong knowledge in Databricks .Knowledge in Cloud Computing – AWS preferably • Knowledge in programming and shell scripting eg. Core/ Python / Scala / Java • Knowledge in Hadoop Stack eg. Hive , Spark (Core and Streaming), Kafka , Flink , NIFI; • Knowledge with Github and Jenkins ; • Knowledge on stream transform using Spark Streaming or Flink; • Knowledge on change data capture in a big data ecosystem; • Knowledge building real time or batch ingestion and transformation pipelines; Additional skills/responsibilities of this role: • Knowledge on supporting a production service in a DevOps friendly environment; • Knowledge on working in Agile/Scrum teams; • Knowledge on API and cloud-native architecture; • Knowledge on with container technology (e.g. Docker, Kubernetes); • Knowledge on wrangling data using library such as Pandas, Scikit-learn or Numpy; • Knowledge on using notebook such as Jupyter or Polyglot; • Knowledge on test-driven development, test automation continuous delivery; • Knowledge on in Java build automation technologies such as Gradle, Maven, Integration with Sonarqube etc.;