Data Engineer – Databricks

Data Engineer – Databricks

6-Month Contract-to-Hire

REMOTE (Local to St. Louis would be a big bonus)

Must be GC Holder or US Citizen

The managers expressed they need a hyper technical hammer! They do not need to have an executive presence, but instead they need to be strong technically.

They will do a live python coding assessment during the interview. It will be an hour long panel style with their client.

If local, great! But fully remote is totally fine. If they have healthcare experience that would be a plus . Majority of this team has come from Express Scripts which would also be a plus! Targeting a mid to sr level. Focusing on Databricks. They are building out this new team and bringing databricks to the org!

Overview

This is a contract opportunity to join a newly formed data engineering team building a modern Databricks platform from the ground up. The client is not looking for someone to maintain legacy ETL jobs—they want engineers who can build reusable frameworks and think like platform engineers.

Must-Haves

Strong, hands-on Databricks experience

Solid Python programming skills

Experience building ETL/ELT pipelines

Strong SQL

Experience with modern cloud data platforms

Able to explain architecture and technical decisions clearly

Preferred Experience

Unity Catalog

Medallion Architecture (Bronze, Silver, Gold)

Data governance (lineage, security, audit logging)

Healthcare or other regulated industries

What the Hiring Team Wants

Engineers who build reusable frameworks—not one-off pipelines

Strong software engineering fundamentals

Someone who understands why Databricks is used, not just how to click through it

Curious, coachable, and excited about AI and modern data engineering

Comfortable talking through their thought process during technical interviews

JOB DESCRIPTION:

We are seeking a Data Engineer to join a team building a modern, cloud-native data platform using Databricks. This is a greenfield opportunity to help transform a legacy, file-based environment into a scalable, automated, and well-governed data ecosystem. Rather than maintaining existing systems, you'll help build reusable frameworks, modern architecture, and platform capabilities that support analytics, AI, and future business initiatives.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Databricks, Python, and SQL.

• Build reusable ETL/ELT frameworks and automation rather than one-off data pipelines.

• Design solutions following the Medallion Architecture (Bronze, Silver, Gold) to support reliable and scalable data processing.

• Implement data governance best practices using Unity Catalog, including security, lineage, and access controls.

• Modernize legacy file-based and batch processing into cloud-native solutions.

• Collaborate with technical teams on platform architecture, engineering standards, and best practices.

• Required Qualifications

• Hands-on experience with Databricks.

• Strong Python programming skills.

• Experience developing scalable ETL/ELT pipelines.

• Strong SQL and data modeling experience.

• Experience working with modern cloud data platforms.

• Understanding of data architecture and software engineering best practices.

• Strong communication skills with the ability to explain technical decisions and collaborate effectively.

Preferred Qualifications

• Experience with Unity Catalog and data governance.

• Experience implementing Medallion Architecture.

• Experience building reusable frameworks, accelerators, or shared engineering components.

• Background in healthcare or other regulated industries.

• Interest in AI, automation, and modern data engineering practices.