Big Data Tester

Job Title: Big Data Tester Experience: 3-6 years Role Overview We are seeking a skilled Big Data Tester with strong expertise in Python, Hadoop ecosystems, and ETL processes . The ideal candidate will be responsible for validating large-scale data pipelines, ensuring data accuracy, performance, and reliability across distributed systems. Key Responsibilities Design and execute test strategies for big data applications and ETL workflows . Validate data ingestion, transformation, and storage processes in Hadoop clusters . Develop automated test scripts using Python for data validation and regression testing. Perform data quality checks , schema validation, and reconciliation across multiple sources. Collaborate with developers, data engineers, and business analysts to ensure end-to-end data integrity. Conduct performance testing for large datasets and optimize test execution. Document test cases, results, and defects; ensure compliance with QA standards. Required Skills Strong hands-on experience in Python scripting for automation and data validation. Proficiency in Hadoop ecosystem tools (HDFS, Hive, Spark, Pig, MapReduce). Solid understanding of ETL concepts and experience with tools like Informatica, Talend, or custom ETL pipelines. Experience with SQL for querying and validating large datasets. Familiarity with data warehousing concepts and big data testing methodologies. Knowledge of test automation frameworks and CI/CD integration.