Data Engineer

Role: Data Engineer

Duration: Long Term

100% Remote

Job Description:

Job Summary:

Client is seeking a Data Engineer with hands-on experience implementing solutions within Microsoft Fabric environments.

The client is a mature Microsoft-based data organization currently leveraging legacy components including Azure Synapse Analytics and Azure Data Factory, and is actively migrating to Microsoft Fabric.

Responsibilities

• Design, build, and maintain scalable batch data pipelines within Microsoft Fabric

• Develop and optimize data processing workflows using Fabric Notebooks and PySpark

• Support migration of existing Synapse and Data Factory workloads into Fabric

• Build robust, production-grade data engineering solutions using Python-based frameworks

• Implement and maintain CI/CD pipelines for data engineering workloads

• Ensure proper versioning, deployment, and lifecycle management of data assets

• Collaborate with Architect, Business Analyst, and QA resources in a lean team environment

• Optimize data ingestion and transformation processes across structured datasets (1–100 TB scale)

• Support data quality, observability, and operational stability across pipelines

• Experience:

• 5+ years of data engineering experience in enterprise environments

• Hands-on experience with Microsoft Fabric implementations (must have supported or led at least one migration or build-out)

• Strong proficiency in Python for data engineering use cases

• Extensive experience with PySpark and distributed data processing

• Experience building batch processing pipelines at scale

• Strong understanding of data lifecycle management and deployment practices

• Experience with CI/CD pipelines for data workflows (Git-based workflows preferred)

• Background working in Microsoft-centric data ecosystems (Synapse, Data Factory, ADLS, etc.)