Padmi

Solution Architect Web Scraping & Data Engineering (Bengaluru)

BangalorePosted 2 months ago
Software engineeringSeniorFull Time; Regular
Apply at Merit Data And Technology

Opens the source posting on shine.com

Source description

About the role

View original

Roles and Responsibilities : - Design and develop scalable data extraction solutions using Python, Kubernetes, and web scraping techniques. - Collaborate with cross-functional teams to identify business requirements and design data extraction workflows that meet those needs. - Develop high-quality code using Scrapy framework to extract structured data from various websites. - Troubleshoot issues related to data extraction, processing, and loading into target systems. Job Requirements : - 11-19 years of experience in IT Services & Consulting industry. - Robust expertise in Data Scraping (Web Scraping), Python programming language, and Kubernetes containerization technology. - Proficiency in developing complex data extraction workflows using Scrapy framework. - Experience working on large-scale projects involving big data processing and loading into target systems. Roles and Responsibilities : - Design and develop scalable data extraction solutions using Python, Kubernetes, and web scraping techniques. - Collaborate with cross-functional teams to identify business requirements and design data extraction workflows that meet those needs. - Develop high-quality code using Scrapy framework to extract structured data from various websites. - Troubleshoot issues related to data extraction, processing, and loading into target systems. Job Requirements : - 11-19 years of experience in IT Services & Consulting industry. - Robust expertise in Data Scraping (Web Scraping), Python programming language, and Kubernetes containerization technology. - Proficiency in developing complex data extraction workflows using Scrapy framework. - Experience working on large-scale projects involving big data processing and loading into target systems.

One address, no account. We’ll tell you when matching roles go live.

More at Merit Data And Technology

Related open roles

View all roles
Solution Architect Web Scraping & Data Engineering (Bengaluru) at Merit Data And Technology · Padmi