ETL Architect

Summary Key Responsibilities ETL Design & Development Design, build, and optimize high-performance ETL/ELT pipelines across multiple data sources. Develop automated workflows using Azure Data Factory (ADF) for reliable data ingestion and transformation. Ensure secure, fault-tolerant data movement from source to target systems. Data Integration & Transformation Build complex transformation logic using Azure Databricks (Spark with Python/Scala). Implement robust data validation, quality checks, and error handling. Ensure accurate, timely, and trusted data for analytics and reporting. Azure Analytics Platform Work extensively with ADF, Databricks, Azure Synapse Analytics, and Azure Purview. Load and manage large structured and unstructured datasets in Azure Synapse. Support analytics and reporting use cases (Power BI consumption layer). Performance & Optimization Tune ETL pipelines to reduce latency and improve throughput. Design scalable architectures that meet high-availability and performance SLAs. Security, Governance & Compliance Implement RBAC, data security, and compliance controls across the Azure ecosystem. Use Azure Purview for data cataloging, lineage, and governance enforcement. Ensure compliance with departmental and regulatory data policies. Leadership & Collaboration Act as a technical lead for ETL/data engineering initiatives. Collaborate with data engineers, analysts, security teams, and business stakeholders. Mentor junior engineers and enforce ETL best practices. Documentation & Standards Create and maintain detailed technical documentation. Define and enforce standards for ETL development, data handling, and security. Required Qualifications 7+ years of experience in ETL development / data engineering. 3+ years hands-on experience with Azure Data Factory, Databricks, Synapse, and Purview. Strong experience building large-scale, high-availability ETL pipelines. Advanced skills in Spark, Python, and/or Scala. Strong SQL skills with complex datasets. Solid understanding of data governance, security, and RBAC in Azure. Preferred Qualifications Microsoft certifications: Azure Data Engineer Associate Azure Solutions Architect Expert Azure Fundamentals Azure Databricks Data Engineer certification