Source description
About the role
Role- DataBricks Data Engineers Duration-6 Months Location- 100% Remote Project Scope / Components: This is part of the OptumInsight project where we are working to develop ingestion pipelines for EIP à Extract data and put it into the raw space – they are using Databricks as the ETL tool. Rather than doing drag and drop dev, they want to use Java & Python to create custom ingestion frameworks. Full tool set is Databricks w/Pyspark or Scala & Java. They will also exposing the analytical interface to EIP w/Scala. Development Methodology: Agile – 2 week sprints High-Level Individual Duties: Must-Haves (Concepts & Tools): Databricks (NOT looking for Databricks & SQL [must be w/Scala or Java]) Pyspark Scala or Java (must be strong in one or the other) Azure is HIGHLY preferred but AWS would be ok Spark based ETL process Nice to haves: Python Java ADF Predictive Analytics is nice, but it’s a learning opportunity that they would work on in phase 3 DeltaLake -- ---- Thanks & Regards, Tejash - Technical Recruiter Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6304918494 EXTN: 157 Email :tejash@thoughtwavesoft.com Website:www.thoughtwavesoft.com https://www.linkedin.com/in/tejash-chettipalli-342aa2246
More at Thoughtwave Software and Solutions