Senior Data Engineer

Focuses on legacy data migration, complex query optimization, and building new cloud pipelines for enterprise-scale data systems.

The position is 100% on-site in Columbus, Ohio and involves working within a hybrid big data architecture using modern data engineering technologies.

The Senior Data Engineer will play a critical role in data warehousing strategies, data quality assurance, and optimizing legacy Oracle and MS SQL Server environments.

Responsibilities

• Design, build, and optimize enterprise-scale data pipelines within a hybrid big data architecture.

• Write highly complex SQL scripts, subqueries, and advanced analytics statements for massive datasets.

• Develop targeted rules and algorithmic mappings specifically for data quality, accuracy, and lineage checks.

• Oversee core Data Warehousing strategies, including data integration and aggressive data cleansing workflows.

• Troubleshoot, debug, and optimize legacy setups natively in Oracle and MS SQL environments.

• Perform legacy data migration and complex query optimization tasks.

• Build and maintain new cloud data pipelines using Databricks and PySpark.

• Required Qualifications

• 6 to 8+ years of experience in pure Data Engineering or Architecture.

• Minimum 2 years of active development experience using Python.

• Minimum 3 years working with Cloud Technologies (AWS/Azure ecosystem).

• Proficiency with Databricks, Python, PySpark, complex SQL, Oracle, and MS SQL Server.

• Experience designing and optimizing enterprise-scale data pipelines.

• Strong experience writing complex SQL scripts and advanced analytics statements.

• Experience with data quality, accuracy, and lineage checks using rules and algorithmic mappings.

• Experience with Data Warehousing strategies, data integration, and data cleansing workflows.

• Ability to troubleshoot, debug, and optimize legacy Oracle and MS SQL Server environments.

• Comfort working inside an Agile Scrum team environment.

• Required Skills & Technologies

• Primary Skills

• Databricks

• Python

• PySpark

• SQL

• Oracle

• MS SQL Server

• Secondary Skills

• AWS

• Azure