#1Web crawling, scraping, spidering, and automated reconnaissance tools for security testing.
Kitploit recommended

The legacy python version of OONI Probe

Scrape and download TikTok video posts, user profiles, hashtag trends, and music feed metadata via CLI or Node.js module. Supports batch downloads,…

Open Source Link Analysis & OSINT Framework

Multi-functional Web Recon & Vulnerability Scanner Tool

NotebookLM on steroids — purpose-built for security researchers.

Attack surface discovery and AI-assisted triage for security researchers. Endpoint & parameter mapping with actionable testing hints.

Passive recon & attack surface mapper — zero requests sent

Find every API request a web app makes, from the JavaScript it ships: method, URL, body, headers and GraphQL operations. One command.

This windows CLI app lets you collect data from twitter via REST API and convert it into a CSV data set that can be used with Gephi. Other social…

A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...

OSINT intelligence on any IP, domain, or ASN

Collects, checks and ranks public HTTP/SOCKS proxies against your own targets, then serves them via ranked exports, pools, a rotating gateway and a…

An open, local-first security testing platform for pentesters, AI agents, CI/CD pipelines, and teams.

Pastenum is a text dump enumeration tool.

Automated reconnaissance and XSS detection framework integrating subfinder, httpx, katana, gospider, waybackurls, and dalfox into a 9-stage pipeline…

CLI tool to search and scrape geotagged photos from VK.com using the VK API, extracting owner names and photo metadata into an HTML report.

WordPress security scanner with AI-powered analysis, ethical compliance framework, and professional reporting.