Padmi

Python Automation and Web Scraping Specialist

IndiaPosted 2 months ago
Software engineeringMid-levelFull Time; Regular
Apply at Foresiet

Opens the source posting on shine.com

Source description

About the role

View original

As an Automation Specialist at Foresiet, you will be responsible for developing and maintaining automation processes to enhance efficiency and streamline operations. Your key responsibilities will include: - Developing and maintaining sophisticated web scraping and automation scripts to extract relevant data efficiently. - Troubleshooting issues related to automation processes and implementing effective solutions. - Understanding and implementing CAPTCHA-solving approaches, working with proxy services, and utilizing anti-blocking strategies such as IP rotation, session management, fingerprinting/stealth, and polite crawling. - Integrating scalable captcha handling with human and automated fallbacks for social media scraping. - Ensuring deployability of solutions through Docker and orchestration, including monitoring, logging, and operational documentation. - Collaborating with the team to identify automation opportunities and implementing innovative solutions. - Creating and executing test cases to ensure the quality and reliability of automation processes. - Staying updated with the latest web technologies, anti-scraping measures, and AI tools to enhance automation capabilities. Qualifications required for this role include: - Proficiency in process automation and automation skills. - Expertise with web scraping libraries and tools such as Beautiful Soup and Scrapy. - Familiarity with anti-blocking strategies like Captcha Bypass, IP rotation, session management, fingerprinting/stealth, and polite crawling. - Experience in social media scraping and troubleshooting skills. - Ability to create and execute test cases, ensure quality assurance, and possess proficiency in Python programming. - Excellent problem-solving and analytical skills to address technical issues efficiently. - Capability to work independently and remotely, demonstrating adaptability and self-motivation. Join Foresiet, an AI-enabled SaaS-based Cybersecurity company, and be part of a team that proactively detects, monitors, and secures digital risks with a unique blend of Human Intelligence and Applied Research. As an Automation Specialist at Foresiet, you will be responsible for developing and maintaining automation processes to enhance efficiency and streamline operations. Your key responsibilities will include: - Developing and maintaining sophisticated web scraping and automation scripts to extract relevant data efficiently. - Troubleshooting issues related to automation processes and implementing effective solutions. - Understanding and implementing CAPTCHA-solving approaches, working with proxy services, and utilizing anti-blocking strategies such as IP rotation, session management, fingerprinting/stealth, and polite crawling. - Integrating scalable captcha handling with human and automated fallbacks for social media scraping. - Ensuring deployability of solutions through Docker and orchestration, including monitoring, logging, and operational documentation. - Collaborating with the team to identify automation opportunities and implementing innovative solutions. - Creating and executing test cases to ensure the quality and reliability of automation processes. - Staying updated with the latest web technologies, anti-scraping measures, and AI tools to enhance automation capabilities. Qualifications required for this role include: - Proficiency in process automation and automation skills. - Expertise with web scraping libraries and tools such as Beautiful Soup and Scrapy. - Familiarity with anti-blocking strategies like Captcha Bypass, IP rotation, session management, fingerprinting/stealth, and polite crawling. - Experience in social media scraping and troubleshooting skills. - Ability to create and execute test cases, ensure quality assurance, and possess proficiency in Python programming. - Excellent problem-solving and analytical skills to address technical issues efficiently. - Capability to work independently and remotely, demonstrating adaptability and self-motivation. Join Foresiet, an AI-enabled SaaS-based Cybersecurity company, and be part of a team that proactively detects, monitors, and secures digital risks with a unique blend of Human Intelligence and Applied Research.

One address, no account. We’ll tell you when matching roles go live.

More at Foresiet

Related open roles

View all roles