Source description
About the role
Role: senior cloud data engineer Location :100% Remote Duration :6 months ONLY ON W2 Project: This team supports a big data solution which ingests data regarding claims, pharmacy, membership, enrollment, etc. from provider orgs and converts the data to a common data structure for Optum’s data analysts to pull. It is an ETL based application which is currently on-prem and they are planning to move it to Azure. They are currently in the initial planning phase and looking to bring in 2 cloud/data engineers to work on the migration Responsibilities: • Will support some of the data architecture/cloud architecture and design • Support the migration from on-prem to cloud • Will run the ETL processes on the data the team ingests Must Haves: • Senior – 8+ years overall, Mid – 5+ years overall experience • Azure – Specifically need Databricks and Delta Lake (should know Delta Lake tables) • Apache Spark • CI/CD in a cloud environment – experience scheduling jobs (Airflow or Jenkins) Nice to Haves: • Cloud infrastructure and infrastructure as code • Snowflake • Airflow – at least some exposure __ _ _ Thanks & Regards, Suganya S / US IT RECRUITER Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6303134033 Email:suganya@thoughtwavesoft.com LinkedIn: https://www.linkedin.com/in/suganya-s-873a8915a/
More at Thoughtwave Software and Solutions