Source description
About the role
Key Responsibilities Architect, develop, and operate enterprise-grade data pipelines using Microsoft Fabric, Azure Data Factory (ADF), PySpark, and Python , aligned to Medallion architecture. Rationalize and modernize the BI data landscape; deliver curated bronze, silver, and gold layers and performant semantic models . Implement data quality, governance, lineage, and observability across pipelines; ensure auditability and compliance. Migrate or retire legacy SSIS/SQL Server integrations to cloud-native, testable, cost-efficient solutions. Apply CI/CD best practices for data engineering using Azure DevOps/Git (branching, PRs, automated testing, environment promotion). Diagnose and resolve complex integration issues across cloud-native and legacy platforms; optimize performance and costs. Collaborate effectively with business analysts, transformation leads, and external partners ; communicate progress and risks clearly. Contribute to Agile delivery cycles , demonstrating initiative, independence, and problem-solving skills.
More at Veralto