
trawl
Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr…

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr…

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Node.js web scraping and browser automation library for building reliable crawlers with HTTP and headless browser support, proxy rotation, and…

Collects, checks and ranks public HTTP/SOCKS proxies against your own targets, then serves them via ranked exports, pools, a rotating gateway and a…

Automated OSINT framework for reconnaissance, data harvesting, and threat intelligence gathering with modular crawlers, scanners, and extraction…

Telegram OSINT, scraping and archival as a local web app. Multi-account collection, profile lookup with historic photos and change diffs, ten export…

HTTrack Website Copier, copy websites to your computer (Official repository)

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

Browser automation framework with a single API for Chromium, Firefox, and WebKit. Supports web testing, scraping, screenshots, and network…

OSINT intelligence on any IP, domain, or ASN

OnionSearch is a script that scrapes urls on different .onion search engines.

Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient CDP snapshots, HAR recording, native…

Web app authorisation coverage scanning

An asynchronous enumeration & vulnerability scanner. Run all the tools on all the hosts.

Collaborative application security testing between humans and agents via CLI and MCP

Passive recon & attack surface mapper — zero requests sent

Simple random DNS, HTTP/S internet traffic noise generator

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface…