Databricks Developer

You will be responsible for designing and developing enterprise-scale data pipelines using Databricks. Your role will involve building and optimizing Lakehouse architectures with Bronze, Silver, and Gold layers. Additionally, you will develop robust ETL/ELT frameworks and data quality solutions. It will be your duty to drive performance tuning, monitoring, and operational excellence. You are expected to implement CI/CD best practices and automated testing frameworks. Collaboration with cross-functional teams to deliver analytics-ready data products is a key aspect of the role. Moreover, mentoring junior engineers and contributing to engineering standards and best practices are essential responsibilities. Key Responsibilities: - Design and develop enterprise-scale data pipelines using Databricks - Build and optimize Lakehouse architectures (Bronze, Silver, Gold layers) - Develop robust ETL/ELT frameworks and data quality solutions - Drive performance tuning, monitoring, and operational excellence - Implement CI/CD best practices and automated testing frameworks - Collaborate with cross-functional teams to deliver analytics-ready data products - Mentor junior engineers and contribute to engineering standards and best practices Qualification Required: - Proficiency in Databricks, Python, PySpark / Spark SQL, SQL / PL-SQL, Delta Lake / Lakehouse Architecture, Azure Cloud Services, Azure DevOps & Git, ETL/ELT Tools (ADF, Fivetran, or equivalent) - Experience with Terraform and Unity Catalog is preferred - Databricks Certification(s) is a plus - Exposure to Pharmaceutical, Healthcare, Life Sciences, or other data-intensive industries is advantageous You will be responsible for designing and developing enterprise-scale data pipelines using Databricks. Your role will involve building and optimizing Lakehouse architectures with Bronze, Silver, and Gold layers. Additionally, you will develop robust ETL/ELT frameworks and data quality solutions. It will be your duty to drive performance tuning, monitoring, and operational excellence. You are expected to implement CI/CD best practices and automated testing frameworks. Collaboration with cross-functional teams to deliver analytics-ready data products is a key aspect of the role. Moreover, mentoring junior engineers and contributing to engineering standards and best practices are essential responsibilities. Key Responsibilities: - Design and develop enterprise-scale data pipelines using Databricks - Build and optimize Lakehouse architectures (Bronze, Silver, Gold layers) - Develop robust ETL/ELT frameworks and data quality solutions - Drive performance tuning, monitoring, and operational excellence - Implement CI/CD best practices and automated testing frameworks - Collaborate with cross-functional teams to deliver analytics-ready data products - Mentor junior engineers and contribute to engineering standards and best practices Qualification Required: - Proficiency in Databricks, Python, PySpark / Spark SQL, SQL / PL-SQL, Delta Lake / Lakehouse Architecture, Azure Cloud Services, Azure DevOps & Git, ETL/ELT Tools (ADF, Fivetran, or equivalent) - Experience with Terraform and Unity Catalog is preferred - Databricks Certification(s) is a plus - Exposure to Pharmaceutical, Healthcare, Life Sciences, or other data-intensive industries is advantageous