ETL Test Engineer

Job Description: You will be responsible for ensuring the quality, accuracy, and reliability of data pipelines and lakehouse architecture built on AWS and Snowflake. Your role will involve testing ETL/ELT workflows, big data systems, and data quality frameworks. Key Responsibilities: - Design and execute test strategies for data pipelines using PySpark and orchestrated via Airflow. - Validate data ingestion, transformation, and storage in S3-based lakehouse (Iceberg tables). - Perform data reconciliation between source systems, lakehouse, and Snowflake business layer. - Develop automated test frameworks for large-scale data validation. - Ensure data quality, completeness, consistency, and performance across pipelines. - Collaborate with data engineers and stewards to enforce data quality rules and governance standards. - Identify, track, and resolve defects in data workflows and reporting layers. Qualifications Required: - Graduate in Computer Science, Data Science, Information Technology, or a related field. - 2-3 years of experience in data quality or data management. (Note: Additional details about the company were not provided in the job description.) Job Description: You will be responsible for ensuring the quality, accuracy, and reliability of data pipelines and lakehouse architecture built on AWS and Snowflake. Your role will involve testing ETL/ELT workflows, big data systems, and data quality frameworks. Key Responsibilities: - Design and execute test strategies for data pipelines using PySpark and orchestrated via Airflow. - Validate data ingestion, transformation, and storage in S3-based lakehouse (Iceberg tables). - Perform data reconciliation between source systems, lakehouse, and Snowflake business layer. - Develop automated test frameworks for large-scale data validation. - Ensure data quality, completeness, consistency, and performance across pipelines. - Collaborate with data engineers and stewards to enforce data quality rules and governance standards. - Identify, track, and resolve defects in data workflows and reporting layers. Qualifications Required: - Graduate in Computer Science, Data Science, Information Technology, or a related field. - 2-3 years of experience in data quality or data management. (Note: Additional details about the company were not provided in the job description.)