Data Engineering and ETL Specialist

Role Overview: You are a skilled Data Engineering and ETL Specialist with 3-4 years of experience in building and managing robust data pipelines and transformation workflows. Your expertise includes proficiency in Snowflake, Matillion, SQL, and Python/PySpark, enabling you to deliver scalable ETL solutions that drive business intelligence and analytics outcomes. Key Responsibilities: - Design, develop, and maintain scalable ETL/ELT pipelines using Matillion and Snowflake. - Build incremental and full-load data ingestion pipelines from diverse source systems (databases, APIs, flat files). - Implement Slowly Changing Dimension (SCD) strategies and data merge patterns for accurate historical tracking. - Optimize Matillion jobs for performance, reusability, and maintainability. - Develop and manage Snowflake objects such as databases, schemas, tables, views, streams, tasks, and pipes. - Tune query performance using clustering keys, materialized views, and warehouse sizing strategies in Snowflake. - Write complex SQL transformations, stored procedures, and UDFs to support business logic. - Develop data models following star/snowflake schema and dimensional modeling best practices. - Implement data quality checks, validation frameworks, and automated reconciliation processes. - Work closely with data architects, analysts, and business stakeholders to understand data requirements. - Write clean, modular, reusable, and well-documented code across SQL, Python, and Matillion. - Participate in code reviews and contribute to team best practices and documentation. Qualifications Required: - Graduates only with 3-4 years of experience in data engineering or ETL development roles. - Demonstrated experience delivering production-grade data pipelines using Snowflake and Matillion. - Strong communication skills, written and verbal; ability to translate technical concepts for business audiences. - Meticulous attention to detail, especially around data accuracy and pipeline reliability. - Ability to work independently and collaborate effectively with cross-functional teams. Company Details: Netscribes is the company that posted this job opportunity. Role Overview: You are a skilled Data Engineering and ETL Specialist with 3-4 years of experience in building and managing robust data pipelines and transformation workflows. Your expertise includes proficiency in Snowflake, Matillion, SQL, and Python/PySpark, enabling you to deliver scalable ETL solutions that drive business intelligence and analytics outcomes. Key Responsibilities: - Design, develop, and maintain scalable ETL/ELT pipelines using Matillion and Snowflake. - Build incremental and full-load data ingestion pipelines from diverse source systems (databases, APIs, flat files). - Implement Slowly Changing Dimension (SCD) strategies and data merge patterns for accurate historical tracking. - Optimize Matillion jobs for performance, reusability, and maintainability. - Develop and manage Snowflake objects such as databases, schemas, tables, views, streams, tasks, and pipes. - Tune query performance using clustering keys, materialized views, and warehouse sizing strategies in Snowflake. - Write complex SQL transformations, stored procedures, and UDFs to support business logic. - Develop data models following star/snowflake schema and dimensional modeling best practices. - Implement data quality checks, validation frameworks, and automated reconciliation processes. - Work closely with data architects, analysts, and business stakeholders to understand data requirements. - Write clean, modular, reusable, and well-documented code across SQL, Python, and Matillion. - Participate in code reviews and contribute to team best practices and documentation. Qualifications Required: - Graduates only with 3-4 years of experience in data engineering or ETL development roles. - Demonstrated experience delivering production-grade data pipelines using Snowflake and Matillion. - Strong communication skills, written and verbal; ability to translate technical concepts for business audiences. - Meticulous attention to detail, especially around data accuracy and pipeline reliability. - Ability to work independently and collaborate effectively with cross-functional teams. Company Details: Netscribes is the company that posted this job opportunity.