Source description
About the role
As an Azure Data Engineer with expertise in Databricks and PySpark, you will be responsible for the following: Role Overview: You will be utilizing your 10 to 13 years of experience to perform design, development, and deployment using various Azure Services such as Data Factory, Databricks, PySpark, and SQL. Your primary role will involve developing and maintaining scalable data pipelines, creating technical specification designs, and application interface designs. Additionally, you will be responsible for developing modern Data Warehouse solutions using Azure Stack, specifically Azure Data Lake, Azure Databricks, and PySpark. Your expertise will be crucial in developing batch processing and integration solutions for both Structured and Non-Structured Data. Key Responsibilities: - Develop and maintain scalable data pipelines - Build new Data Source integrations to support increasing data volume and complexity - Create Technical Specification Design and Application Interface Design - Develop Modern Data Warehouse solutions using Azure Stack and PySpark - Develop batch processing and integration solutions for Structured and Non-Structured Data - Collaborate with BI & analytics and the business team Qualifications Required: - Minimum 2 years of Project experience in Azure Databricks - Minimum 2 years of experience in Azure Data Factory (ADF) - Minimum 2 years of experience in PySpark In this role, your demonstrated in-depth skills with Azure Databricks, PySpark, and SQL will be essential. You will have the opportunity to collaborate and engage with BI & analytics and the business team to drive impactful data solutions. As an Azure Data Engineer with expertise in Databricks and PySpark, you will be responsible for the following: Role Overview: You will be utilizing your 10 to 13 years of experience to perform design, development, and deployment using various Azure Services such as Data Factory, Databricks, PySpark, and SQL. Your primary role will involve developing and maintaining scalable data pipelines, creating technical specification designs, and application interface designs. Additionally, you will be responsible for developing modern Data Warehouse solutions using Azure Stack, specifically Azure Data Lake, Azure Databricks, and PySpark. Your expertise will be crucial in developing batch processing and integration solutions for both Structured and Non-Structured Data. Key Responsibilities: - Develop and maintain scalable data pipelines - Build new Data Source integrations to support increasing data volume and complexity - Create Technical Specification Design and Application Interface Design - Develop Modern Data Warehouse solutions using Azure Stack and PySpark - Develop batch processing and integration solutions for Structured and Non-Structured Data - Collaborate with BI & analytics and the business team Qualifications Required: - Minimum 2 years of Project experience in Azure Databricks - Minimum 2 years of experience in Azure Data Factory (ADF) - Minimum 2 years of experience in PySpark In this role, your demonstrated in-depth skills with Azure Databricks, PySpark, and SQL will be essential. You will have the opportunity to collaborate and engage with BI & analytics and the business team to drive impactful data solutions.
More at Birlasoft