Source description
About the role
Title: Azure Data Engineer Location: REMOTE Duration: 6 month contract + extensions, Responsibilities: • Build data pipelines and pulling from RDBMS • Using Kafka for stream • All Azure based • Once data is in Databricks, it will flow into a reporting platform in Tableau (once it’s to this phase it will go to a different team) • Building Azure Lakehouse concept • Understand how to build E2E pipeline Must have: • Azure Databricks • Experience building data pipelines • Healthcare data experience • Scala/Python/PySpark • Jenkins or Azure DevOps (need to know CICD concepts) • ADF • SQL Nice to have: • Azure Lakehouse Thanks & Regards Syam B, 630-923-6952 syam@thoughtwavesoft.com
More at Thoughtwave Software and Solutions