Crawler

seladb/pcapplusplus

Multiplatform C++ library for high-performance network packet capture, parsing, crafting, and analysis. Supports libpcap, DPDK, AF_XDP, PF_RING, and…

chocapikk/wpprobe

A fast WordPress plugin enumeration tool

instaloader/instaloader

Download pictures (or videos) along with their captions and other metadata from Instagram.

hahwul/deadfinder

Fast CLI tool to scan websites, sitemaps, and URL lists for broken links, with concurrent workers, coverage reporting, and multiple output formats.

rndinfosecguy/scavenger

Crawler (Bot) searching for credential leaks on paste sites.

apify/fingerprint-suite

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

affolter-engineering/xssearch

Rust-based XSS scanner with context-aware payload selection, WAF detection and bypass, crawling, blind XSS callbacks, and static DOM sink analysis.

khashashin/ogi

Open Source Link Analysis & OSINT Framework

opengraphintel/ogi-transforms

Open Source Link Analysis & OSINT Framework

noptrix/httpgrep

Async HTTP(S) scanner that greps response bodies and headers for strings or regex across hosts, ports, CIDR/ranges and TLS-cert vhosts.

emrekybs/signalops

All-source intelligence fusion dashboard — WiFi, cellular, CCTV, ADS-B, orbital & SDR feeds unified into a single tactical map. Security research…

lc/gau

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

austin-weeks/miasma

Trap AI web scrapers in an endless poison pit.

sensepost/gowitness

🔍 gowitness - a golang, web screenshot utility using Chrome Headless

ericmtzmtz/pwnproxy

An open, local-first security testing platform for pentesters, AI agents, CI/CD pipelines, and teams.

ambitsecurity/jshound

Find every API request a web app makes, from the JavaScript it ships: method, URL, body, headers and GraphQL operations. One command.