#1Web crawling, scraping, spidering, and automated reconnaissance tools for security testing.
Kitploit recommended

🔍 gowitness - a golang, web screenshot utility using Chrome Headless
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

Multiplatform C++ library for high-performance network packet capture, parsing, crafting, and analysis. Supports libpcap, DPDK, AF_XDP, PF_RING, and…

Hunt down 840+ social media accounts using AI

HTTrack Website Copier, copy websites to your computer (Official repository)

The Ultimate Information Gathering Toolkit

The Ultimate Information Gathering Toolkit

Next generation web scanner

Undetected version of the Playwright testing and automation library.

OSINT Tools for the Dark Web

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application

🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos,…

Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

Automated Web Application Firewall fingerprinting tool that identifies and detects over 200 WAF products by analyzing HTTP responses to normal and…

💯 Teach puppeteer new tricks through plugins.

A Python module to bypass Cloudflare's anti-bot page.

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:

Phone number OSINT toolkit with multi-API search (Google, GitHub, Numverify, Reddit, DuckDuckGo), Hudson Rock infostealer intelligence, and automatic…