One-Time Website Data Scrape
Employer not named by the sourceRemote
Frontier is not the employer and does not collect applications.
About this role
PHP, Python, Excel, Web Scraping, Node.js, Scrapy, Data Scraping, BeautifulSoup · I need all publicly visible text, images, and product-specific details extracted from a single website and handed back to me in a clean CSV file. This is a one-off job, not an ongoing crawl, so the script only needs to run once—though I’d like to keep the code for my records in case I decide to repeat the process later.
The CSV should include columns for every piece of information that appears on the product pages (titles, descriptions, prices, image URLs, SKU or ID codes, category paths, and any other attributes you’re able to capture). All referenced images must be downloaded as files and organised in a folder structure that mirrors the CSV paths.
Key points • Accuracy matters: fields should align consistently across rows. • No duplicates or missing records. • Respect the target site’s robots.txt and rate-limit requests to avoid throttling. • Deliver both the finished CSV and the source script (Python with BeautifulSoup/Scrapy, Node with Puppeteer, or your preferred tool). • Include a brief readme so I can rerun the script without hassle.
Once I verify record counts and spot-check a few entries, I’ll release payment.