Padmi

Senior Data Engineer

Delhi NCRPosted 3 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Unicorn Workforce

Opens the source posting on shine.com

Source description

About the role

View original

As a Senior Data Engineer, you will play a crucial role in our growing data team by leveraging your expertise in Snowflake, AWS, Python, SQL, DBT, and Luigi. Your responsibilities will include architecting modern data solutions, optimizing performance, mentoring team members, and collaborating with stakeholders effectively. Key Responsibilities: - Lead end-to-end Snowflake migration projects, ensuring seamless migration with complete data integrity and minimal business disruption. Design scalable Snowflake data architectures and models, and optimize performance through clustering, partitioning, and query tuning. Implement best practices for security, governance, and scalability. - Design, build, and maintain scalable ETL/ELT pipelines using Python and DBT. Develop complex workflows using Luigi, process large-scale datasets, and implement data validation and reliability frameworks. - Configure, deploy, and manage AWS services like EC2, S3, RDS, and EMR. Develop secure, scalable, and cost-efficient cloud-based data solutions, support data processes, and monitor infrastructure performance. - Enhance and maintain existing data platforms, identify opportunities for modernization, and contribute to legacy system improvements. Qualifications Required: - 5-8 years of experience in data engineering roles, with expertise in Snowflake, AWS, Python, SQL, DBT, and Luigi. - Proven experience in building scalable data platforms, developing ETL/ELT pipelines, and leading cloud migration initiatives. - Strong knowledge of AWS services, data validation, and quality checks. - Excellent communication skills, ability to mentor team members, and collaborate effectively with stakeholders. Please note: UAN is mandatory for this role. As a Senior Data Engineer, you will play a crucial role in our growing data team by leveraging your expertise in Snowflake, AWS, Python, SQL, DBT, and Luigi. Your responsibilities will include architecting modern data solutions, optimizing performance, mentoring team members, and collaborating with stakeholders effectively. Key Responsibilities: - Lead end-to-end Snowflake migration projects, ensuring seamless migration with complete data integrity and minimal business disruption. Design scalable Snowflake data architectures and models, and optimize performance through clustering, partitioning, and query tuning. Implement best practices for security, governance, and scalability. - Design, build, and maintain scalable ETL/ELT pipelines using Python and DBT. Develop complex workflows using Luigi, process large-scale datasets, and implement data validation and reliability frameworks. - Configure, deploy, and manage AWS services like EC2, S3, RDS, and EMR. Develop secure, scalable, and cost-efficient cloud-based data solutions, support data processes, and monitor infrastructure performance. - Enhance and maintain existing data platforms, identify opportunities for modernization, and contribute to legacy system improvements. Qualifications Required: - 5-8 years of experience in data engineering roles, with expertise in Snowflake, AWS, Python, SQL, DBT, and Luigi. - Proven experience in building scalable data platforms, developing ETL/ELT pipelines, and leading cloud migration initiatives. - Strong knowledge of AWS services, data validation, and quality checks. - Excellent communication skills, ability to mentor team members, and collaborate effectively with stakeholders. Please note: UAN is mandatory for this role.

One address, no account. We’ll tell you when matching roles go live.

More at Unicorn Workforce

Related open roles

View all roles