Azure Databricks Engineer

Role Overview: We are looking for a highly skilled Azure Databricks Engineer with 8 10 years of overall IT experience and strong expertise in designing, developing, and managing enterprise-scale data solutions on Microsoft Azure. The ideal candidate should have a minimum of 5 years of hands-on experience working with Azure data engineering services, especially Azure Databricks and Azure SQL. The role involves building scalable data pipelines, implementing data quality frameworks, enabling secure data access, and supporting modern data platform initiatives using Azure-native technologies. The candidate will work closely with cross-functional onshore and offshore teams to deliver high-quality data engineering solutions and support AI-driven data initiatives within Databricks. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks. Implement and manage data transformation, ingestion, replication, and CDC processes using PySpark, SQL, and related tools. Build and maintain robust Data Quality frameworks using DLT and DQX within Databricks environments. Manage secure handling of PII data through encryption/decryption mechanisms and secure service account access. Work extensively with Azure SQL and optimize database performance, queries, and data models. Configure and manage Azure security services including Azure Key Vault, Azure Entra ID, Azure RBAC, and Azure IAM. Support CI/CD implementation and deployment activities using Azure DevOps and DABS. Develop Databricks agents and work with Databricks AI-related components and capabilities. Collaborate effectively with global teams across development, testing, and production support activities. Ensure adherence to enterprise security, governance, and compliance standards. Required Skills: Strong hands-on experience with: Azure Data Factory Azure Databricks Azure SQL PySpark SQL Data Quality frameworks (DLT DQX) Azure Key Vault Azure Entra ID Azure DevOps DABS Azure RBAC IAM Experience in Data Replication and CDC implementations using tools like Stelo or similar technologies. Strong understanding of cloud security, access management, and data governance. Experience with Databricks AI capabilities and agent creation. Excellent communication and coordination skills for working with distributed teams. Preferred Qualification: Databricks Certification is mandatory. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.