Source description
About the role
We are seeking a skilled and motivated Data Engineer to join our data modernization initiative within a leading insurance organization. This role will focus on migrating legacy data pipelines from Azure Data Factory (ADF) and SQL Server to a modern stack using Snowflake, Python, and Coalesce. The ideal candidate will have a strong background in data engineering, cloud data platforms, and ETL/ELT orchestration, with bonus points for experience integrating with Power BI.
Key Responsibilities
• Migrate and modernize existing ADF and SQL Server-based data pipelines to Snowflake using Python and Coalesce.
• Design, develop, and maintain scalable ETL/ELT workflows to support data ingestion, transformation, and delivery.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver robust solutions.
• Optimize data models and queries for performance and cost-efficiency in Snowflake.
• Ensure data quality, integrity, and governance across all pipelines.
• Integrate Snowflake datasets with Power BI for reporting and analytics.
• Monitor and troubleshoot data pipeline issues and implement proactive improvements.
• Document processes, data flows, and architecture for transparency and maintainability.
Required Qualifications
• Bachelor’s degree in computer science, Engineering, or related field.
• 5+ years of experience in data engineering or related roles.
• Proficiency in SQL, Python, and Snowflake.
• Experience with Azure Data Factory and SQL Server.
• Familiarity with Coalesce or similar ELT orchestration tools.
• Understanding of data warehousing concepts and cloud data architecture.
• Experience with Power BI or other BI tools is a strong plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration abilities.
Preferred Skills
• Experience in the insurance industry.
• Knowledge of data governance frameworks and compliance standards.
• Familiarity with CI/CD pipelines and version control (e.g., Git).
• Exposure to Agile methodologies and tools like Jira or Azure DevOps.
More at Novisync