Crawler

rverton/webanalyze

Port of Wappalyzer (uncovers technologies used on websites) to automate mass scanning.

zigoo0/jsonbee

A ready to use JSONP endpoints/payloads to help bypass content security policy (CSP) of different websites.

robre/jsmon

a javascript change monitoring tool for bugbounties

ktzgraph/sarenka

OSINT tool - gets data from services like shodan, censys etc. in one app

dirtyfilthy/freshonions-torscraper

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

devanshbatham/favfreak

Making Favicon.ico based Recon Great again !

vigolium/vigolium

Vigolium - High-fidelity vulnerability scanner fusing agentic AI with native speed, modularity, and precision

dwisiswant0/go-dork

The fastest dork scanner written in Go.

vmfunc/sif

the blazing-fast pentesting suite.

anoncatalyst/ominis-osint

Automated OSINT reconnaissance tool that queries Google and social platforms to gather intelligence on usernames and queries, with proxy rotation and…

hackmanit/web-cache-vulnerability-scanner

Go-based CLI scanner for web cache poisoning and deception. Supports 10 poisoning techniques, multiple deception methods, built-in crawler, JSON…

sensepost/snoopy-ng

Snoopy v2.0 - modular digital terrestrial tracking framework

r3nt0n/bopscrk

Generates targeted password wordlists by combining personal info, applying case/leet transforms, and scraping artist lyrics for enhanced cracking…

xillwillx/skiptracer

OSINT python webscaping framework

ni5arga/sightline

An OSINT search engine for mapping real-world infrastructure from OpenStreetMap data

runanywhereai/on-device-browser-agent

On-device AI browser automation using WebLLM. No cloud, no API keys, fully private.

kgretzky/dcrawl

Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.