Crawler

silverpoision/rock-on

Rock-On is a all in one Recon tool that will just get a single entry of the Domain name and do all of the work alone.

arpsyndicate/kenzer

automated web assets enumeration & scanning [DEPRECATED]

si9int/cc.py

Extracting URLs of a specific target based on the results of "commoncrawl.org"

atmoner/twitwork

✨ Monitor twitter stream from nodejs electron

c6fc/warcannon

High speed/Low cost CommonCrawl RegExp in Node.js

menkrep1337/xsscon

XSSCon: Simple XSS Scanner tool

r4ygm/dorkscout

Automated Google dork scanner that fetches exploit-db dork lists and scans targets or the entire internet for vulnerable applications, secret files,…

batuhaniskr/twitter-intelligence

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

authcov/authcov

Web app authorisation coverage scanning

cr0hn/festin

FestIn - Open S3 Bucket Scanner

mrcl0wnlab/scanner-inurlbr

Advanced search in search engines, enables analysis provided to exploit GET / POST capturing emails & urls, with an internal custom validation…

offensive-hub/black-widow

GUI based offensive penetration testing tool (Open Source)

josue87/metafinder

Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata

sirbugs/endext

Extracts all possible endpoints, URLs, and paths from JavaScript files using customizable regex patterns for web application reconnaissance and API…

a3h1nt/grawler

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them…

bhavsec/autopentest-ai

Agentic Pentesting MCP server that discovers, exploits, and reports web application vulnerabilities.

hahwul/urx

Extracts URLs from OSINT Archives for Security Insights