Padmi

Senior Data Engineer

IndiaPosted 3 months ago
Software engineeringSeniorFull Time; Regular
Apply at DE Shaw

Opens the source posting on shine.com

Source description

About the role

View original

As a Data Engineer, your role involves developing and maintaining automated data extraction and parsing systems. You will also be responsible for monitoring website changes to ensure data accuracy and uptime. Additionally, designing scalable, high-performing data pipelines and ETL workflows will be a key part of your responsibilities. Supporting operations to maintain data integrity and availability is also an essential aspect of your job. Your key responsibilities include: - Developing and maintaining automated data extraction and parsing systems - Monitoring website changes to ensure data accuracy and uptime - Designing scalable, high-performing data pipelines and ETL workflows - Supporting operations to maintain data integrity and availability To excel in this role, you are required to have: - Strong Python coding skills with hands-on experience in scraping frameworks - Proficiency in relational databases and SQL queries - Familiarity with HTML, CSS, JavaScript, and debugging tools - Solid academic background with applied knowledge of data structures and algorithms As a Data Engineer, your role involves developing and maintaining automated data extraction and parsing systems. You will also be responsible for monitoring website changes to ensure data accuracy and uptime. Additionally, designing scalable, high-performing data pipelines and ETL workflows will be a key part of your responsibilities. Supporting operations to maintain data integrity and availability is also an essential aspect of your job. Your key responsibilities include: - Developing and maintaining automated data extraction and parsing systems - Monitoring website changes to ensure data accuracy and uptime - Designing scalable, high-performing data pipelines and ETL workflows - Supporting operations to maintain data integrity and availability To excel in this role, you are required to have: - Strong Python coding skills with hands-on experience in scraping frameworks - Proficiency in relational databases and SQL queries - Familiarity with HTML, CSS, JavaScript, and debugging tools - Solid academic background with applied knowledge of data structures and algorithms

One address, no account. We’ll tell you when matching roles go live.

More at DE Shaw

Related open roles

View all roles