Data Engineer - Microsoft Fabric

As a Data Engineer in the Microsoft Fabric team, your role involves designing, building, and maintaining the modern data platform. Your responsibilities include integrating SAP data sources, developing data models, managing data transformations, and ensuring reliable data pipelines within the Fabric environment. Key Responsibilities: - Design, build, and optimize data pipelines using tools like Data Factory, Lakehouse, and Warehouse in Microsoft Fabric. - Implement data ingestion processes for SAP systems with appropriate connectors and integration tools. - Develop scalable ETL/ELT processes focusing on data quality, performance, and maintainability. - Structure data in Bronze/Silver/Gold layers following medallion architecture practices and maintain semantic models for reporting and analytics. - Create efficient data models for reporting, analytics, and ML workloads using SQL, PySpark, Python, and Fabric notebooks. - Ensure proper metadata mapping, schema evolution handling, and lineage documentation. - Apply and manage Row-Level Security (RLS) and Object-Level Security (OLS) across datasets and semantic models. - Contribute to data governance frameworks aligned with Fabric's workspace, domain, and permission model. - Collaborate with Data Stewards, Architects, and Domain Owners to establish data standards and quality metrics. - Automate pipeline deployments and model updates using DevOps CI/CD integrations with Fabric. - Maintain a scalable development workflow based on Git integration. - Collaborate with business analysts, report creators, and data consumers to understand requirements and provide scalable data solutions. - Share expertise on Fabric capabilities, data integration techniques, and best practices. - Support troubleshooting, performance tuning, and continuous improvement of data services. Required Skills & Experience: - Proven experience as a Data Engineer in cloud-based analytics environments like Microsoft Fabric, Azure Synapse, or Databricks. - Hands-on experience with SAP Data Integration tools. - Proficiency in SQL, Python, and data transformation frameworks. - Experience with building pipelines in Microsoft Fabric using Data Factory, Notebooks, Pipelines, and Lakehouse. - Understanding of medallion architecture, warehouse/lakehouse modeling, and semantic layer design. - Practical knowledge of RLS, OLS, workspace security, and Fabric governance. - Experience with Git, version control, and CI/CD pipelines. Preferred Qualifications: - Experience with Data Engineering tools and technologies. - Knowledge of Power BI, semantic model optimization, and DAX fundamentals. - Exposure to data governance frameworks, data cataloging, and data lifecycle management. - Familiarity with enterprise integration technologies involving SAP and Microsoft ecosystems. - Knowledge of enterprise data architecture patterns like Data Mesh. As a Data Engineer in the Microsoft Fabric team, your role involves designing, building, and maintaining the modern data platform. Your responsibilities include integrating SAP data sources, developing data models, managing data transformations, and ensuring reliable data pipelines within the Fabric environment. Key Responsibilities: - Design, build, and optimize data pipelines using tools like Data Factory, Lakehouse, and Warehouse in Microsoft Fabric. - Implement data ingestion processes for SAP systems with appropriate connectors and integration tools. - Develop scalable ETL/ELT processes focusing on data quality, performance, and maintainability. - Structure data in Bronze/Silver/Gold layers following medallion architecture practices and maintain semantic models for reporting and analytics. - Create efficient data models for reporting, analytics, and ML workloads using SQL, PySpark, Python, and Fabric notebooks. - Ensure proper metadata mapping, schema evolution handling, and lineage documentation. - Apply and manage Row-Level Security (RLS) and Object-Level Security (OLS) across datasets and semantic models. - Contribute to data governance frameworks aligned with Fabric's workspace, domain, and permission model. - Collaborate with Data Stewards, Architects, and Domain Owners to establish data standards and quality metrics. - Automate pipeline deployments and model updates using DevOps CI/CD integrations with Fabric. - Maintain a scalable development workflow based on Git integration. - Collaborate with business analysts, report creators, and data consumers to understand requirements and provide scalable data solutions. - Share expertise on Fabric capabilities, data integration techniques, and best practices. - Support troubleshooting, performance tuning, and continuous improvement of data services. Required Skills & Experience: - Proven experience as a Data Engineer in cloud-based analytics environments like Microsoft Fabric, Azure Synapse, or Databricks. - Hands-on experience with SAP Data Integration tools. - Proficiency in SQL, Python