Source description
About the role
Job Description: You are a Data Engineer with over 5 years of experience, possessing a strong expertise in Microsoft Fabric, PySpark, and SQL. Your main responsibility will be to design, build, and optimize scalable data pipelines and analytics solutions. You will work with modern data platform components to deliver high-performance data solutions. Key Responsibilities: - Design and develop data pipelines using Microsoft Fabric and Azure Data platforms - Build data transformations using PySpark and SQL in Spark Notebooks and Lakehouse - Develop and manage data models in Fabric Warehouse and Lakehouse - Optimize performance of Spark jobs and SQL queries - Implement data quality checks, monitoring, and error handling - Collaborate with BI and business teams to deliver data solutions - Support production issues and continuous improvements Qualifications Required: - Solid experience with Microsoft Fabric and Azure data platform - Hands-on expertise in PySpark and SQL - Experience with Fabric components such as Data Factory, Synapse, Spark Notebooks, Lakehouse, and Warehouse - Experience with Azure services like ADLS, Azure SQL, and Azure DevOps - Knowledge of ETL/ELT, data modeling, and distributed data processing - Experience with CI/CD and version control (Git) Job Description: You are a Data Engineer with over 5 years of experience, possessing a strong expertise in Microsoft Fabric, PySpark, and SQL. Your main responsibility will be to design, build, and optimize scalable data pipelines and analytics solutions. You will work with modern data platform components to deliver high-performance data solutions. Key Responsibilities: - Design and develop data pipelines using Microsoft Fabric and Azure Data platforms - Build data transformations using PySpark and SQL in Spark Notebooks and Lakehouse - Develop and manage data models in Fabric Warehouse and Lakehouse - Optimize performance of Spark jobs and SQL queries - Implement data quality checks, monitoring, and error handling - Collaborate with BI and business teams to deliver data solutions - Support production issues and continuous improvements Qualifications Required: - Solid experience with Microsoft Fabric and Azure data platform - Hands-on expertise in PySpark and SQL - Experience with Fabric components such as Data Factory, Synapse, Spark Notebooks, Lakehouse, and Warehouse - Experience with Azure services like ADLS, Azure SQL, and Azure DevOps - Knowledge of ETL/ELT, data modeling, and distributed data processing - Experience with CI/CD and version control (Git)
More at VRIZE INC