Crawler

pwn0sec/pwnxss

PwnXSS: Vulnerability (XSS) scanner exploit

itsmehacker/darkscrape

OSINT Tool For Scraping Dark Websites

bywalks/darkangel

Automated white-hat vulnerability scanner that monitors HackerOne and Bugcrowd assets, performs subdomain enumeration, crawling, fingerprinting, and…

kahunalu/pwnbin

Python Pastebin Webcrawler that returns list of public pastebins containing keywords

fcavallarin/htcap

htcap is a web application scanner able to crawl single page application (SPA) recursively by intercepting ajax calls and DOM changes.

nhoya/gosint

OSINT Swiss Army Knife

s0md3v/uro

declutters url lists for crawling/pentesting

owasp/d4n155

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

justicerage/freedomfighting

A collection of scripts which may come in handy during your freedom fighting activities.

z0m31en7/uscrapper

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface…

vida-nyu/ache

Focused web crawler that uses page classifiers and link prioritization to efficiently collect domain-specific or pattern-matching web pages, with…

l4rm4nd/linkedindumper

Python 3 script to dump/scrape/extract company employees from LinkedIn API

4ier/neo

Turn any web app into an API. Chrome extension captures browser traffic, auto-generates schemas, lets AI replay APIs directly. No official API needed.

0xprateek/stardox

Github stargazers information gathering tool

s0md3v/wappalyzer-next

detect technologies with wappalyzer alternative

justrach/kuri

Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient CDP snapshots, HAR recording, native…

silverpoision/rock-on

Rock-On is a all in one Recon tool that will just get a single entry of the Domain name and do all of the work alone.