Padmi

Senior Data Quality Engineer

IndiaPosted 2 months ago
Software QualitySeniorFull Time; Regular
Apply at EPAM Systems

Opens the source posting on shine.com

Source description

About the role

View original

We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team. The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices. Responsibilities Design, develop, and execute automated test scripts for validating ETL workflows and data pipelinesPerform end-to-end data validation, reconciliation, and DWH/DB testing across large datasetsCollaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are metDevelop reusable and scalable test automation frameworks using Python and SQLIntegrate automated tests into CI/CD pipelines to ensure continuous testing and deliveryValidate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming Requirements Experience: 5.5 + YearsStrong hands-on experience in ETL automation and Data Warehouse/Data Lake testingProficient in SQL for data validation and test automationGood knowledge of Python for scripting and framework developmentExperience with one or more Test Automation FrameworksExposure to Cloud Data Services across major platformsAzure (ADF, ADB)AWS (Glue, Lambda, Redshift)GCP (BigQuery)Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)Familiarity with Agile/Scrum methodologies Nice to have Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)Basic understanding of data governance and metadata management conceptsCertification in cloud platforms (Azure/AWS/GCP) is a plus We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team. The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices. Responsibilities Design, develop, and execute automated test scripts for validating ETL workflows and data pipelinesPerform end-to-end data validation, reconciliation, and DWH/DB testing across large datasetsCollaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are metDevelop reusable and scalable test automation frameworks using Python and SQLIntegrate automated tests into CI/CD pipelines to ensure continuous testing and deliveryValidate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming Requirements Experience: 5.5 + YearsStrong hands-on experience in ETL automation and Data Warehouse/Data Lake testingProficient in SQL for data validation and test automationGood knowledge of Python for scripting and framework developmentExperience with one or more Test Automation FrameworksExposure to Cloud Data Services across major platformsAzure (ADF, ADB)AWS (Glue, Lambda, Redshift)GCP (BigQuery)Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)Familiarity with Agile/Scrum methodologies Nice to have Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)Basic understanding of data governance and metadata management conceptsCertification in cloud platforms (Azure/AWS/GCP) is a plus

One address, no account. We’ll tell you when matching roles go live.

More at EPAM Systems

Related open roles

View all roles