Padmi

Senior Data Engineer - SQL

MumbaiPosted 2 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at NewVision Software & Consultancy

Opens the source posting on shine.com

Source description

About the role

View original

As a Senior Data Engineer with 6-9 years of experience, your primary responsibilities will include: - Implementing PII masking pipeline for data security - Building and maintaining a synthetic data generator - Integrating CI/CD pipeline with auto-seed data - Validating generated data against the ground truth, ensuring referential integrity, volume accuracy, and other data validation characteristics Your technical skills should include proficiency in: - Python (specifically Faker, factory-boy, custom generators) or Node.js - Database management in SQL Server and PostgreSQL, with a focus on efficient insertion at scale - Integration of CI/CD pipelines using tools such as GitHub Actions and Azure DevOps - Knowledge of data masking techniques such as tokenization, hashing, and format-preserving encryption - Experience with API-based data seeding through REST or GraphQL endpoints - Ability to optimize performance for generating and loading millions of records efficiently Please note that the company may provide additional details about its culture, values, or projects in the job description. As a Senior Data Engineer with 6-9 years of experience, your primary responsibilities will include: - Implementing PII masking pipeline for data security - Building and maintaining a synthetic data generator - Integrating CI/CD pipeline with auto-seed data - Validating generated data against the ground truth, ensuring referential integrity, volume accuracy, and other data validation characteristics Your technical skills should include proficiency in: - Python (specifically Faker, factory-boy, custom generators) or Node.js - Database management in SQL Server and PostgreSQL, with a focus on efficient insertion at scale - Integration of CI/CD pipelines using tools such as GitHub Actions and Azure DevOps - Knowledge of data masking techniques such as tokenization, hashing, and format-preserving encryption - Experience with API-based data seeding through REST or GraphQL endpoints - Ability to optimize performance for generating and loading millions of records efficiently Please note that the company may provide additional details about its culture, values, or projects in the job description.

One address, no account. We’ll tell you when matching roles go live.

More at NewVision Software & Consultancy

Related open roles

View all roles
Senior Data Engineer - SQL at NewVision Software & Consultancy · Padmi