Free social media scraper for public data with your AI agent

Social media scraping means collecting public data from social platforms (posts, comments, profiles, and engagement counts) into a structured format like a spreadsheet. With ego (lite), your coding Agent opens the public pages in a visible browser on your Mac, reads the rendered content, and writes a source-linked CSV or Markdown report you can audit.

Install ego (lite), give your Agent the target pages, and specify the fields, result limit, and output format. The Agent opens each page in its own Space, records the visible content, and writes the final files. You can watch any Space while it works and take over if a page asks for a human decision.

Any platform whose public pages your authorized browser session can open. Reddit, X, LinkedIn, Instagram, YouTube, TikTok, Facebook, and smaller communities all work the same way because the Agent reads rendered pages instead of calling one API per platform. For platform-specific fields and examples, this site has dedicated Reddit, X, LinkedIn, Instagram profile, and YouTube scraper pages.

Not for a bounded, reviewable batch. Scraping APIs make sense when you need millions of rows on a schedule and can maintain a data pipeline. For fifty threads or twenty profiles, ego (lite) lets the Agent you already use read the rendered pages directly. No API keys, no subscription, no per-result metering, and every row stays tied to its source.

A crawler discovers pages by following links across a site. A scraper extracts structured fields from pages you already chose. This workflow is a scraper: you provide the list of public pages, and the Agent records the requested fields from each one. It does not wander a platform collecting everything it can reach.

Yes, for the profile fields that render publicly: display name, handle, bio, follower and post counts as displayed, and recent public posts. The Agent applies the same columns to every profile in your list, so the result is a consistent table rather than a pile of screenshots. It cannot read private profiles or contact details the platform does not show.

Only when you are authorized to view the content and choose an ego (lite) browser context that already has the required session. The Agent never asks for or enters your credentials. If the session lacks access, or the page shows a CAPTCHA or consent screen, the Agent stops and hands the visible Space back to you.

Rules differ by platform and jurisdiction. Platform terms restrict automated collection in different ways, and privacy laws such as GDPR can apply to personal data even when it is public. This workflow keeps you on the cautious side: it reads only rendered pages from an authorized session, respects every block instead of evading it, and records how each row was collected. Review the relevant platform's terms and your local rules before you collect.

Yes. Ask your Agent for CSV, Markdown, or both, with the same fields in each file. You can also request a short summary of page coverage, row counts per platform, and any page that was blocked or needs your review.

Traditional scrapers depend on hand-written selectors that break when a platform changes its layout. An Agent reads the rendered page the way a person does, so the same prompt keeps working across platforms and layout updates without per-site parser code. The trade-off is scale: this suits supervised batches, not millions of unattended requests.

ego (lite) is free to download for Mac. The workflow uses the coding Agent you already run, Claude Code, Codex, or Cursor, so its token usage and any provider costs still apply. It is designed for visible, supervised batches rather than an unlimited unattended crawl.