#1Web crawling, scraping, spidering, and automated reconnaissance tools for security testing.
Kitploit recommended

Python Pastebin Webcrawler that returns list of public pastebins containing keywords
htcap is a web application scanner able to crawl single page application (SPA) recursively by intercepting ajax calls and DOM changes.


Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface…

Open Source Link Analysis & OSINT Framework

A collection of scripts which may come in handy during your freedom fighting activities.

On-device AI browser automation using WebLLM. No cloud, no API keys, fully private.

Egyscan The Best web vulnerability scanner; it's a multifaceted security powerhouse designed to fortify your web applications against malicious…

Focused web crawler that uses page classifiers and link prioritization to efficiently collect domain-specific or pattern-matching web pages, with…

Crawl and extract (regular or onion) webpages through TOR network

detect technologies with wappalyzer alternative

Darkweb crawler that uses requests and Selenium workers to fetch pages, capture headers and cookies, extract links, and save rendered screenshots for…


Project Eyes On is a high-speed, multi-threaded surveillance tool by Y0oshi (@rde0) for locating open IP cameras worldwide. Unifies Google Dorking…

CLI tool for structured Telegram OSINT data collection. Scrapes members, messages, invite links, and user metadata from public/private groups,…

CTI Cyber Threat Intelligence OSINT Dark Web Deep Web Research. Ransomware gang information gathering tool.

Automated web domain reconnaissance and security assessment tool integrating subdomain enumeration, port scanning, vulnerability scanning, and…

Rock-On is a all in one Recon tool that will just get a single entry of the Domain name and do all of the work alone.