Databricks Admin

Key Responsibilities

Administer and support the Databricks workspace environment across development, test, and production.

Manage user provisioning, role-based access controls, service principles, groups, and entitlements.

Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.

Monitor platform health, job performance, usage trends, and operational incidents.

Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.

Support Unity Catalog, data governance standards, and workspace-level administration.

Develop and maintain automation for workspace setup, policy enforcement, monitoring, and administrative tasks.

Support CI/CD and infrastructure-as-code practices for Databricks deployments and configuration management.

Troubleshoot platform, connectivity, identity federation, and job execution issues.

Create and maintain operational documentation, runbooks, standards, and support procedures.

Understanding data engineering workflows using Spark, notebooks, Delta Lake, and job scheduling.

Required Qualifications

Experience with Azure Cloud.

Strong understanding of identity and access management, including SSO, SCIM, RBAC, and service principals.

Experience with Databricks cluster management, workspace administration, job orchestration, and governance controls.

Knowledge of networking concepts such as VNet/VPC, private endpoints, firewalls, DNS, and secure connectivity.

Experience with scripting or automation using Python, PowerShell, Bash, Terraform, or similar tools.

Familiarity with monitoring, logging, alerting, and incident response processes.

Strong troubleshooting, communication, and cross-functional collaboration skills.

Key Skills

Databricks Workspace Administration

Unity Catalog and Governance

Cluster Policies and Performance Tuning

Cloud Platform Integration

Security and Access Management

Automation and Infrastructure as Code

Cost Optimization

Troubleshooting and Operational Support

Documentation and Cross-Functional Collaboration

Logic Apps, APIM, App Gateways