#1Web crawling, scraping, spidering, and automated reconnaissance tools for security testing.
Kitploit recommended

AI-powered web scraping and data extraction library that extracts structured information from any webpage using natural language instructions, with…
7.45M-document cyber threat intelligence corpus and benchmark linking hacker-forum, exploit and advisory text to 340K NVD CVEs, with temporal splits…

Automated steganography detection tool that scans websites, web servers, and local directories using AI-driven object/text recognition and deep file…

Fetches JavaScript files quickly and comprehensively.

Non API. Crawling post (photo, likes, comments, date ...) by username, hashtags

Crawlector is a threat hunting framework designed for scanning websites for malicious objects.

Selenium based web scraper to generate passwords list

Collaborative application security testing between humans and agents via CLI and MCP

Joomla Vulnerability Component Scanner

Burp Suite's extension to scan and crawl Single Page Applications

Exploit for CVE-2018-20555: automated discovery and takeover of Twitter accounts via leaked API keys in vulnerable Social Network Tabs WordPress…

Fucking Search Engines Scraper - python library to scrap url's from search engines

From Dork to Download: Automating Google Dorks with Playwright

Recursively spider webpages to discover all URLs by following links, parsing sitemaps, and robots.txt files. Ideal for security reconnaissance and…

Dump place details from Google Maps like phone,email,website,and reviews

Inventus is a spider designed to find subdomains of a specific domain by crawling it and any subdomains it discovers.

Automated detection and tracking of fake engagement on GitHub — daily CI, zero infrastructure

A JavaScript components vulnerability scanner, based on RetireJS