Padmi

Senior Databricks Platform Developer

BangalorePosted 2 months ago
Software engineeringSeniorFull Time; Regular
Apply at CareerNet Technologies Pvt Ltd

Opens the source posting on shine.com

Source description

About the role

View original

Key Skills: Azure Databricks, Terraform, Databricks, Python, Azure, IAC, Data Bricks, Rbac, Entra ID, Cluster, Azure Key Vault, Spark Roles and Responsibilities: Design and maintain IaC modules using Terraform for Databricks workspaces, clusters, cluster policies, and permissions to prevent manual drift.Develop Databricks Asset Bundle templates for jobs, DLT pipelines, SQL assets, and workspace configurations.Implement workspace bootstrap automation for repos, catalogs, schemas, and service principal setup.Integrate Azure Key Vault for secrets and configuration management with zero inline secrets; enforce Unity Catalog governance models and permission hierarchies.Build audit logging pipelines for workspace events, Unity Catalog audits, and job logs routed to central monitoring/SIEM; define compliance controls for masking and retention across environments.Skills Required: 3.1 - 4.5 years of relevant platform/infrastructure engineering experience with Databricks or Azure data platforms.Azure and Azure Databricks platform development and administration experience.Terraform-based infrastructure-as-code for Databricks infrastructure and policies.Python proficiency for platform automation and operational tooling.CI/CD standards and deployment automation using Databricks Asset Bundles and promotion gates across Dev/QA/Prod.Good to Have: Spark experience for Databricks workloads and pipeline optimization.Experience working with Databricks cluster configuration and related operational controls.Education: Relevant degree (or equivalent practical experience) in Computer Science, Engineering, or a related field Key Skills: Azure Databricks, Terraform, Databricks, Python, Azure, IAC, Data Bricks, Rbac, Entra ID, Cluster, Azure Key Vault, Spark Roles and Responsibilities: Design and maintain IaC modules using Terraform for Databricks workspaces, clusters, cluster policies, and permissions to prevent manual drift.Develop Databricks Asset Bundle templates for jobs, DLT pipelines, SQL assets, and workspace configurations.Implement workspace bootstrap automation for repos, catalogs, schemas, and service principal setup.Integrate Azure Key Vault for secrets and configuration management with zero inline secrets; enforce Unity Catalog governance models and permission hierarchies.Build audit logging pipelines for workspace events, Unity Catalog audits, and job logs routed to central monitoring/SIEM; define compliance controls for masking and retention across environments.Skills Required: 3.1 - 4.5 years of relevant platform/infrastructure engineering experience with Databricks or Azure data platforms.Azure and Azure Databricks platform development and administration experience.Terraform-based infrastructure-as-code for Databricks infrastructure and policies.Python proficiency for platform automation and operational tooling.CI/CD standards and deployment automation using Databricks Asset Bundles and promotion gates across Dev/QA/Prod.Good to Have: Spark experience for Databricks workloads and pipeline optimization.Experience working with Databricks cluster configuration and related operational controls.Education: Relevant degree (or equivalent practical experience) in Computer Science, Engineering, or a related field

One address, no account. We’ll tell you when matching roles go live.

More at CareerNet Technologies Pvt Ltd

Related open roles

View all roles