Data Engineer

The Job Description:

GENERAL SUMMARY

As a Senior Data Engineer, you will play a pivotal role in collecting, processing, and analyzing large datasets to derive meaningful business insights. You will collaborate with cross-functional teams, including data scientists and business analysts, to develop data pipelines, create interactive dashboards, and implement analytical solutions. This position requires a blend of technical expertise, creativity, and a keen understanding of business processes.

You will mentor a team of Data Engineers, Data Integration Specialists and Data Analysts to build scalable, robust analytics systems to solve complex healthcare challenges. This role will be tasked with the design, development, and maintenance of software responsible for administering ELT transformations and quality processes to ensure the integrity of our data footprint within the warehouse.

Skills & Competencies

• Coach and mentor the Analytics Engineering team: guiding, planning, and reviewing the team's work.

• Collaborate with senior management to define and execute the company's data pipeline strategy, aligning it with business objectives and ensuring data governance principles are followed.

• Design and develop ELT pipelines and transformations for publication of data marts to be used for higher level analytics.

• Conduct exploratory data analysis, identify patterns, trends, and outliers, and translate complex data into actionable insights and visualizations.

• Develop and implement data models to support analytical solutions, ensuring scalability, efficiency, and accuracy.

• Work closely with data scientists, business analysts, and stakeholders to understand business requirements and translate them into analytical solutions. Collaborate with the engineering team to integrate analytical solutions into production systems.

• Monitor usage and performance of warehouse resources and implement creative solutions for improving performance and reducing costs of said resources.

• Stay updated with the latest technologies and trends in data analytics and engineering. Apply new tools and techniques to enhance the efficiency and effectiveness of data analysis processes.

Qualifications

• Educational/Experience Requirements:

• Bachelor's or advanced degree in Computer Science, Information Management, Data Science, or a related field. Master's degree preferred.

• 5 years of experience in data and analytic engineering, with a track record of progressively increasing responsibilities.

• 3 years of experience in health care and health plan data analysis experience preferred.

• Proficiency in using data processing frameworks (e.g., snowpipe, fivetran), databases (e.g. Snowflake, MSSQL) and GCP , Azure cloud.

• Experience with ETL tool such as SSIS, Talend, DataFlow, ADF or airflow required.

• Knowledge of machine learning concepts and algorithms is a plus.

• Snowflake, DBT and GIT experience required.

• Strong leadership and team management skills, with the ability to motivate and develop team members.

• Excellent communication and interpersonal skills, with the ability to collaborate effectively across departments.

• Required Skills and Abilities:

• Evaluate and implement data integration technologies and tools to ensure seamless data flow and interoperability.

• Implement processes to monitor and improve data quality through regular data cleansing, validation, and enrichment activities.

• Work closely with analytics teams to define data requirements and create a data quality framework that supports advanced analytics, reporting, and visualization.

• Foster a data-driven culture by promoting the use of data insights to drive business decisions and innovation.