Source description
About the role
As a Data Engineer, your role involves developing and maintaining automated data extraction and parsing systems. You will also be responsible for monitoring website changes to ensure data accuracy and uptime. Additionally, designing scalable, high-performing data pipelines and ETL workflows will be a key part of your responsibilities. Supporting operations to maintain data integrity and availability is also an essential aspect of your job. Your key responsibilities include: - Developing and maintaining automated data extraction and parsing systems - Monitoring website changes to ensure data accuracy and uptime - Designing scalable, high-performing data pipelines and ETL workflows - Supporting operations to maintain data integrity and availability To excel in this role, you are required to have: - Strong Python coding skills with hands-on experience in scraping frameworks - Proficiency in relational databases and SQL queries - Familiarity with HTML, CSS, JavaScript, and debugging tools - Solid academic background with applied knowledge of data structures and algorithms As a Data Engineer, your role involves developing and maintaining automated data extraction and parsing systems. You will also be responsible for monitoring website changes to ensure data accuracy and uptime. Additionally, designing scalable, high-performing data pipelines and ETL workflows will be a key part of your responsibilities. Supporting operations to maintain data integrity and availability is also an essential aspect of your job. Your key responsibilities include: - Developing and maintaining automated data extraction and parsing systems - Monitoring website changes to ensure data accuracy and uptime - Designing scalable, high-performing data pipelines and ETL workflows - Supporting operations to maintain data integrity and availability To excel in this role, you are required to have: - Strong Python coding skills with hands-on experience in scraping frameworks - Proficiency in relational databases and SQL queries - Familiarity with HTML, CSS, JavaScript, and debugging tools - Solid academic background with applied knowledge of data structures and algorithms
More at DE Shaw
Related open roles
Financial Operations (Gurugram)
Delhi NCR
Senior Member, Data Engineer (Data Extraction) (Secunderabad)
Hyderabad
Lead, Tech (DESIM Backend) (Bengaluru)
Bangalore
Lead or Principal Manager, Product Management
Delhi NCR
Lead / Principal Manager, Interaction Design
Bangalore
Senior Member or Lead, Tech/Software Developer
Delhi NCR