Data Engineer-Web Scraping

Hi, With reference to your profile on job portal we would like to share an opportunity with you for one of our Gurgaon Based client for Remote job. Please find below the details regarding same: Location: Remote/WFH Experience: 2-5 Years Title: Data Engineer - Web Scraping Notice Period: Only Immediate Joiner - 30 Days Max Job Responsibilities Mandatory Technical Skills Required for this role: (Non-Negotiable) Python Pandas Web Scraping (Selenium, requests, Beautiful Soup, Scrapy, Playwright) Data Cleaning, Data Extraction, Data Transformation, and Data Manipulation Education Qualification Required and Experience Required: Must have Bachelors/masters degree in computer science or in any related field 2-5 Years software development experience Strong Python and SQL/Database skills Strong expertise in using Pandas library (Python) is a must Experience with web technologies (HTML/JS, APIs, etc.) Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation and Data replacements. Excellent verbal and written communication skills Aptitude for designing infrastructure, data products, and tools for Data Scientists Preferred Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) Experience containerizing workloads with Docker (Kubernetes a plus) Experience with build automation (Jenkins, Gitlab CI/CD) Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc. Role Summary Performing Web Scraping using various scraping techniques and then utilizing Pythons Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools Role Overview The Web Scraping Team is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation. In your role, you will: Collaborate with analysts to understand and anticipate requirements. Design, implement, and maintain Web scrapers for a wide variety of alternative datasets. Perform Data Cleaning, Exploration, Transformation etc. of scraped data. Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows. Author QC checks to validate data availability and integrity. Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day- to- day operations. Design and implement products and tools to enhance the Web scraping Platform. If in case you are interested to avail this opportunity then please revert with your updated profile asap to dbetal@vanassociates.com Note: Do not change the subject line while reverting. Total Exp:Relevant experience in Python, Pandas, Data Cleansing, Data Transformation, Web Scraping:Current CTC:Expected CTC:Official Notice Period:Ready to work remotely:Availability for MS Teams Interviews in Weekdays: Thanks & Regards, Devanshu Vanguard HR Associates Pvt. Ltd. Phone No- +918851081580 E-Mail:- dbetal@vanassociates.com .