
Agent-Reach
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

CLI to download websites' actual JS/CSS/assets (not flattened HTML)

Node.js web scraping and browser automation library for building reliable crawlers with HTTP and headless browser support, proxy rotation, and…

Collects, checks and ranks public HTTP/SOCKS proxies against your own targets, then serves them via ranked exports, pools, a rotating gateway and a…

Privacy-respecting metasearch engine that aggregates results from multiple search services without tracking or profiling users. Self-hostable with…

HTTrack Website Copier, copy websites to your computer (Official repository)

Searches dark web and onion search engines for keywords and returns matching onion links, with optional local database storage and Ahmia blacklist…

Command-line tool to scrape and download media (photos, videos, stories) from VKontakte users and communities using the VK API. Supports multiple…

parsing search results from startpage search engine (based on google.com results)