Python Social Media Scraper

PHP, JavaScript, Python, Software Architecture, API, BeautifulSoup, Selenium, Data Collection · I need a lightweight Python script that can automatically collect user-profile information from public social-media posts. My immediate goal is to feed a list of post URLs or user handles into the script and receive a clean, structured dataset (CSV or JSON) that contains the core profile fields—username, display name, bio, follower/following counts, and any other non-private details that are easily exposed on the page.

I haven’t locked myself to a single platform, so feel free to design the solution around the APIs or HTML structures of Twitter, Facebook, Instagram, or a combination that you think will hold up over time. If official endpoints are rate-limited or incomplete, please outline any headless-browser or request-based fallback you plan to use, along with how you will stay within each site’s terms of service.

Essential deliverables • Well-commented Python code (ideally 3.10+), organised in reusable functions or a small module. • A requirements.txt or Pipfile so I can recreate the environment. • A short README explaining setup, configuration (API keys, cookies, etc.) and how to run a sample scrape. • One example output file showing the captured profile data.

I’m happ