
httrack
HTTrack Website Copier, copy websites to your computer (Official repository)

HTTrack Website Copier, copy websites to your computer (Official repository)

Automate browser based workflows with AI

Fast CLI tool to scan websites, sitemaps, and URL lists for broken links, with concurrent workers, coverage reporting, and multiple output formats.

Extracts URLs from OSINT Archives for Security Insights

Open-source web application security scanner for automated vulnerability detection, manual penetration testing, and API security testing with a…

Fast, multi-probe HTTP toolkit for reconnaissance and information gathering. Probes TLS, CSP, headers, tech stack, and CDN. Supports matchers,…

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price…

Adaptive web scraping framework with anti-bot bypass, automatic element relocation, concurrent crawling, proxy rotation, and browser automation for…

Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational…

Automated OSINT framework for reconnaissance, data harvesting, and threat intelligence gathering with modular crawlers, scanners, and extraction…

MCP server providing web scraping, crawling, and search capabilities for AI agents. Supports structured data extraction, interactive browsing, and…

Fast YAML-based vulnerability scanner with template-driven detection engine for automated security testing across web apps, APIs, networks, DNS, and…

Community curated list of templates for the nuclei engine to find security vulnerabilities.

🕵️♂️ Collect a dossier on a person by username from 6K websites

The world's fastest agentic crawler. Reclaimed. Reinvented. Ready for war.

Browser automation framework with a single API for Chromium, Firefox, and WebKit. Supports web testing, scraping, screenshots, and network…