Padmi

Databricks Data Engineer with a Solution Architect

Dublin · OnsitePosted 1 month ago
Infrastructure And DatabasesUnspecified
Apply at Prophecy Technologies

Opens the source posting on prophecytechs.com

Source description

About the role

View original

Client: tcs | Engagement: Full-time | Work mode: ONSITE | Rate: 70-80 USD | Experience: 10 | Publisher job id: 100281-1

Job Description:As a Databricks Data Engineer with a Solution Architect background, you will lead the design of enterprise-scale data

solutions, establish engineering standards and best practices, optimize platform performance and cost, and provide

technical leadership for cloud modernization, real-time analytics, AI/ML enablement, and data governance initiatives.

This role requires strong expertise in Spark, Delta Lake, Unity Catalog, cloud architecture, Infrastructure as Code (IaC),

and modern data platform engineering principles to deliver secure, resilient, and highly scalable solutions.

We are seeking a highly skilled and experienced Senior Solution Architect to lead the implementation and adoption of the

Databricks Lakehouse Platform as part of our enterprise data strategy. This role will serve as the technical leader and

subject matter expert for Databricks, supporting multiple business segments and strategic initiatives across the

organization

Roles & Responsibilities

Responsibilities

  • · Applies advanced expertise in Databricks, Spark, Delta Lake, and cloud-native architectures to

  • design and govern large-scale enterprise data platforms.

  • · Leads architecture decisions for cloud-based data and analytics solutions, ensuring

  • scalability, security, resiliency, and operational excellence across Azure, AWS, or GCP

  • environments.

  • · Establishes and evolves platform standards, best practices, and governance frameworks for

  • data engineering, streaming, AI/ML, and analytics workloads.

  • · Recommends innovative technologies, architectural patterns, and optimization strategies to

Role Descriptions: Skills - Databricks (Python and SQLPySpark) - Azure SQL Server (Managed Instance| Azure SQL DB| SQL Server VMs) - Data modeling and ETLELT design patterns - Docker and Azure Kubernetes Service (AKS) for select automation - Performance optimization and scalabilityExperience - 7 years enterprise data engineering - Healthcare data integration experience strongly preferred - Experience with large-scale data harmonization and normalization Essential Skills: Skills - Databricks (Python and SQLPySpark) - Azure SQL Server (Managed Instance| Azure SQL DB| SQL Server VMs) - Data modeling and ETLELT design patterns - Docker and Azure Kubernetes Service (AKS) for select automation - Performance optimization and scalabilityExperience - 7 years enterprise data engineering - Healthcare data integration experience strongly preferred - Experience with large-scale data harmonization and normalization Desirable Skills: Keyword: Skills: Digital : Python~Azure Data Factory Experience Required: 8-10

One address, no account. We’ll tell you when matching roles go live.

More at Prophecy Technologies

Related open roles

View all roles