Robust Allegro.pl Product Scraper
Employer not named by the sourceRemote
Frontier is not the employer and does not collect applications.
About this role
PHP, Python, Web Scraping, Software Architecture, Data Extraction, API, Data Collection, Data Management · Hi,
I’m looking for a developer to build a reliable product scraper for Allegro.pl.
The scraper should be able to collect product data at scale, including:
Product name Price Product URL Images Seller information Availability Category Other relevant product details
The solution should be robust, scalable, and minimize the risk of IP bans or request blocking by using appropriate request rates, caching, retries, and other legitimate scraping best practices.
Please let me know if you have experience with large-scale web scraping and anti-bot protected websites, and provide examples of similar projects you have completed.