Source description
About the role
We are looking for a Data Engineering Manager/Consultant with deep expertise in Databricks, Delta Lake, and Unity Catalog. The role involves defining data architecture, governance strategy, and leading scalable cloud data platform implementations. Responsibilities - Define data architecture using Databricks and Delta Lake - Lead development of scalable and governed data pipelines - Implement Unity Catalog governance frameworks - Guide teams on Spark optimization and best practices - Ensure data platform reliability, security, and scalability - Review and approve technical designs Required Skills: - Databricks - PySpark - Spark SQL - Delta Lake - Unity Catalog - SQL - Data Architecture Valuable to Have: - Kafka - Airflow - CI/CD - MLflow - Data Governance - Power BI/Tableau We are looking for a Data Engineering Manager/Consultant with deep expertise in Databricks, Delta Lake, and Unity Catalog. The role involves defining data architecture, governance strategy, and leading scalable cloud data platform implementations. Responsibilities - Define data architecture using Databricks and Delta Lake - Lead development of scalable and governed data pipelines - Implement Unity Catalog governance frameworks - Guide teams on Spark optimization and best practices - Ensure data platform reliability, security, and scalability - Review and approve technical designs Required Skills: - Databricks - PySpark - Spark SQL - Delta Lake - Unity Catalog - SQL - Data Architecture Valuable to Have: - Kafka - Airflow - CI/CD - MLflow - Data Governance - Power BI/Tableau
More at Nasugroup