Data Engineer

Data Engineer KPI Partners is seeking a talented and motivated Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing scalable data solutions using Microsoft Fabric . You will play a key role in building modern data platforms, developing efficient data pipelines, and enabling data-driven decision-making across the organization. Key Responsibilities Design and implement data integration processes using Microsoft Fabric to streamline data flow from multiple enterprise data sources. Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. Develop and maintain scalable ETL/ELT processes for efficient data extraction, transformation, and loading. Build and optimize Fabric Data Factory Pipelines , Copy Activities , Dataflow Gen2 , and Notebook executions. Orchestrate end-to-end data workflows, including Bronze Silver Gold (Medallion Architecture) processing. Configure pipeline scheduling, dependency chains, retry policies, timeout handling, parameter passing, variables, and dynamic expressions. Optimize data pipelines for performance, scalability, reliability, and data quality. Monitor and troubleshoot data processing issues, ensuring timely resolution and minimal disruption to business operations. Work closely with data analysts, architects, and business users to support analytics and reporting initiatives. Stay up to date with Microsoft Fabric capabilities and industry best practices in data engineering. Qualifications Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. 612 years of experience as a Data Engineer with strong hands-on expertise in Microsoft Fabric . Experience building and managing Fabric Data Factory Pipelines , Dataflow Gen2 , and PySpark/Spark Notebooks . Strong knowledge of SQL , data modeling, and ETL/ELT development. Experience with Lakehouse architecture and Medallion (Bronze, Silver, Gold) data processing. Familiarity with cloud-based data platforms and modern data engineering practices. Strong analytical, troubleshooting, and problem-solving skills. Excellent communication and collaboration abilities. Experience with Power BI or other data visualization tools is an added advantage.