Source description
About the role
Role Overview: As a Data Engineer with 5+ years of experience, your primary responsibility will be to design, build, and optimize scalable data pipelines and analytics solutions using your expertise in Microsoft Fabric, PySpark, and SQL. You will work with modern data platform components to deliver high-performance data solutions. Key Responsibilities: - Design and develop data pipelines using Microsoft Fabric and Azure Data platforms - Build data transformations using PySpark and SQL in Spark Notebooks and Lakehouse - Develop and manage data models in Fabric Warehouse and Lakehouse - Optimize performance of Spark jobs and SQL queries - Implement data quality checks, monitoring, and error handling - Collaborate with BI and business teams to deliver data solutions - Support production issues and continuous improvements Qualification Required: - Strong experience with Microsoft Fabric and Azure data platform - Hands-on expertise in PySpark and SQL - Experience with Fabric components such as Data Factory, Synapse, Spark Notebooks, Lakehouse, and Warehouse - Experience with Azure services like ADLS, Azure SQL, and Azure DevOps - Knowledge of ETL/ELT, data modeling, and distributed data processing - Experience with CI/CD and version control (Git) Role Overview: As a Data Engineer with 5+ years of experience, your primary responsibility will be to design, build, and optimize scalable data pipelines and analytics solutions using your expertise in Microsoft Fabric, PySpark, and SQL. You will work with modern data platform components to deliver high-performance data solutions. Key Responsibilities: - Design and develop data pipelines using Microsoft Fabric and Azure Data platforms - Build data transformations using PySpark and SQL in Spark Notebooks and Lakehouse - Develop and manage data models in Fabric Warehouse and Lakehouse - Optimize performance of Spark jobs and SQL queries - Implement data quality checks, monitoring, and error handling - Collaborate with BI and business teams to deliver data solutions - Support production issues and continuous improvements Qualification Required: - Strong experience with Microsoft Fabric and Azure data platform - Hands-on expertise in PySpark and SQL - Experience with Fabric components such as Data Factory, Synapse, Spark Notebooks, Lakehouse, and Warehouse - Experience with Azure services like ADLS, Azure SQL, and Azure DevOps - Knowledge of ETL/ELT, data modeling, and distributed data processing - Experience with CI/CD and version control (Git)
More at VRIZE INC