Azure Big Data Engineer

Greetings, Hope you are doing well. Please go through below Job description and lf you are comfort/available for the position then respond with latest/updated resume to srinivas@wavsols.com or 630-397-0596/140 VENDOR NOTES: We still need Big Data Engineers with strong Azure experience. We have no external competition on this opening and have placed this position the last two times it was open. A Big Data Engineer that’s strong in Spark and has good experience with Azure WILL WIN! At the moment, I only have one candidate going through an internal technical screening. ********************************** This person will be migrating Big Data Warehouses from on-prem to Azure. We are looking for a senior level resource who understands Data Warehouses, Azure services, and has worked with large data sets using Spark for streaming. I’ve attached the resume of my contractor currently on the team who is doing GREAT! The hiring team wants another Siva!! Thanks for your help! Role: Azure Data Engineer Location: Eden Prairie, MN (remote to start) Duration: 6 month contract-to-hire Visa Restrictions: Can only consider candidates who don’t require sponsorship at this time (USC, GC, GC-EAD, H4, TN) Subvending: This is fine but they must be able to convert full-time eventually Top Requirements: • Azure • SQL • Data warehousing • Data engineering (Big Data) • Spark • Working w/ streams Our Notes from speaking with the Hiring Manger: 6 Month C2H Eden Prairie MN UHGJP00059069 Project & Team Details: • This team is looking to move their big data operations into Azure • They need a senior resource who understands data warehouses, PowerBI, SQL server, & other Azure services to help mentor the team in moving big data software into the cloud • This resource needs to be senior with solid Azure experience in data engineering • The team runs scrum agile w/ 9 total scrum teams Day-today / Responsibilities: • Data engineering on azure • Help migrate data warehouses from on-prem to the cloud • Lead big data developers in Azure services like Azure Autoscale (only acting as a SME for azure, leading by answering questions). • Large data sets - Big Data; spark. • Mapr environment Req. Skills: • Azure • SQL • Data warehousing • Data engineering (Big Data) • Spark • Working w/ streams Pref. Skills: • Kafka Screening Topics: • Azure General • Azure datafactory • SQL • Apache Spark Formal Job Description: • Provide technical leadership and build in architecture, design and engineering in modernization of legacy Data Ingestion, ETL and Database to new technologies in the Public Cloud (AWS/Azure), Big Data and API Space • Lead the technology transformation from our legacy Data and Analytic platforms to a Big Data Cloud based Modern Software paradigm. Be innovative in solution design and development to meet the needs of the business. • Create a common framework and repository for the development of Modern APIs available to the Optum Product Engineering Team • Demonstrate leadership in the context of software engineering and be an evangelist for engineering best practices • Create next generation streaming applications to use our Data as a strategic platform to grow the top line revenue • Stay abreast of leading-edge technologies in the industry evaluating emerging software technologies • Work collaboratively with all business areas to assess unmet/new business needs and solutions • Encourage the growth of junior engineers on the team through skills development, mentoring and technical guidance • Create a “startup mentality” to accelerate the introduction of new capabilities and transform teams • Avid supporter of the Open Source software community • Excellent time management, communication, decision making, and presentation skills • Display a strong desire to achieve and attain high levels of both internal and external customer satisfaction Required: • BS / BA in Engineering, Computer Science or equivalent experience • 8+ years of software product development experience working on commercially available software and / or healthcare platforms • 6+ months of experience developing solutions hosted within public cloud providers such as Azure and AWS or private cloud/container based systems using Mesos, Kubernetes/OpenShift • Java/Scala development experience • Experience with Big Data technologies like HDFS, Hive, Spark, Kafka • Experience with Kubernetes, Big Data technologies like Spark, Hbase, MapReduce, Storm, Flume, Sqoop, Pig, Apache Drill, Oozie, Zeppelin • Experience managing, leading, and / or mentoring teams in using Big Data technologies • Experience in using modern software engineering and product development tools including Agile / SAFE, Continuous Integration, Continuous Delivery, DevOps etc. • Proven track record of acting as an advocate for driving new technology across the organization via the creation of communities and publishing SDK / libraries for reuse across the organization • Strong experience of operating in a quickly changing environment and driving technological innovation to meet business requirement • Proven track record of building relationships across cross-functional teams Preferred: • Experience building Big Data solutions on public cloud (Azure) • Experience building data pipelines with Kafka and Kafka Streams • Experience developing Java RESTful Services using SpringBoot • Good understanding of Microservices architecture • Experience with Automation Frameworks – Selenium WebDriver, Restassured, SOAP UI • Ability to establish repeatable processes, best practices and implement version control software in a Cloud team environment • Experience of developing cloud based API gateways would be highly desirable • Experience / exposure to API integration frameworks • Experience in the healthcare industry