Automated Supplier Price Scraper

Java, Python, Web Scraping, Software Architecture, Scrapy, Data Extraction, BeautifulSoup, API Development · I want to stop checking supplier portals one item at a time and instead trigger a script that pulls every SKU, full description and up-to-date price from the catalogues at https://www.mercante.com.br/, https://www.idbatacadistas.com.br/ and https://www.bartofil.com.br/.

The data must land in a clean, well-structured CSV because that is the format I feed into our internal quotation workflow and the AI tools that follow. I will run the extraction once a week, so the solution should be easy to schedule (cron job, GitHub Actions, Cloud Function or a comparable option you prefer).

Please include a brief but detailed project proposal outlining: • the language and libraries you plan to use (Python + BeautifulSoup/Scrapy, Node + Puppeteer, etc.) • how you will deal with authentication, pagination and potential anti-bot measures on the three sites • the structure of the final CSV (mandatory columns: SKU/code, description, unit price, packaging info, date captured) • how I will configure new suppliers or fields later without touching the core code

Deliverables will be: 1. Fully documented source code for the scraper. 2. One sample CSV containing a complete export from ea