Crawler

circl/ail-framework

AIL framework - Analysis Information Leak framework. Project moved to https://github.com/ail-project

bigbodycobain/shadowbroker

Real-time geospatial OSINT platform aggregating 60+ public telemetry feeds (ADS-B, AIS, satellites, CCTV) into a unified map with server-side recon…

soxoj/socid-extractor

⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites

d4vinci/scrapling

Adaptive web scraping framework with anti-bot bypass, automatic element relocation, concurrent crawling, proxy rotation, and browser automation for…

maurosoria/dirsearch

Web path scanner

vigolium/vigolium

Vigolium - High-fidelity vulnerability scanner fusing agentic AI with native speed, modularity, and precision

katrielmoses/voidaccess

Self-hosted dark web OSINT platform. Automated threat intelligence from query to graph in 13 steps. Free alternative to Recorded Future, DarkOwl, and…

projectdiscovery/wappalyzergo

A high performance go implementation of Wappalyzer Technology Detection Library

s0md3v/photon

Incredibly fast crawler designed for OSINT.

daijro/camoufox

🦊 Anti-detect browser

hahwul/urx

Extracts URLs from OSINT Archives for Security Insights

topscoder/nuclei-wordfence-cve

80k+ WordPress Nuclei templates, updated daily from Wordfence intel—filter by severity/tags/CVE and scan in one line. 🚀🔒

emrekybs/socmintelligence

A modular OSINT & SOCMINT framework for social media intelligence, investigation, and public data analysis.

tacone/prosey

Download YouTube transcripts

go-appsec/toolbox

Collaborative application security testing between humans and agents via CLI and MCP

epi052/feroxbuster

A fast, simple, recursive content discovery tool written in Rust.