
dcrawl
Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.

Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.

Tool to find JavaScript files on Websites

OSINT Tool For Scraping Dark Websites

Automated white-hat vulnerability scanner that monitors HackerOne and Bugcrowd assets, performs subdomain enumeration, crawling, fingerprinting, and…

declutters url lists for crawling/pentesting

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

Focused web crawler that uses page classifiers and link prioritization to efficiently collect domain-specific or pattern-matching web pages, with…

Python 3 script to dump/scrape/extract company employees from LinkedIn API

Github stargazers information gathering tool

detect technologies with wappalyzer alternative

Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient CDP snapshots, HAR recording, native…

🕵️ Python project to crawl for JavaScript files and search for secrets like API keys, authorization tokens, hardcoded credentials, etc.

Extracting URLs of a specific target based on the results of "commoncrawl.org"

Extracts URLs from OSINT Archives for Security Insights

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them…

CLI to download websites' actual JS/CSS/assets (not flattened HTML)

An automated tool which can simultaneously crawl, fill forms, trigger error/debug pages and "loot" secrets out of the client-facing code of sites.