Source description
About the role
Experience 4 to 15 years of total experience in data engineering or software engineering. 3+ years of dedicated hands-on experience with the Databricks platform in production environments. Strong background in big data engineering, cloud data platforms, and distributed computing. Databricks Platform Deep expertise in Databricks Workspaces, Clusters, Jobs, Workflows, and Repos. Proficiency with Unity Catalog metastore setup, catalog/schema/table management, access controls, and data lineage. Hands-on experience with Delta Live Tables (DLT) pipeline development, expectations, and monitoring. Strong command of Delta Lake internals transaction log, ACID guarantees, file layout, and optimization techniques. Experience with Databricks SQL Warehouses, SQL Analytics, and dashboard creation. Knowledge of Databricks Photon engine, serverless compute, and cost optimization strategies. PySpark & SQL .
More at Vrinda Global