
crawlee
Node.js web scraping and browser automation library for building reliable crawlers with HTTP and headless browser support, proxy rotation, and…

Node.js web scraping and browser automation library for building reliable crawlers with HTTP and headless browser support, proxy rotation, and…

Curated collection of wordlists for security assessments, including usernames, passwords, URLs, fuzzing payloads, and sensitive data patterns for…

Fast, multi-probe HTTP toolkit for reconnaissance and information gathering. Probes TLS, CSP, headers, tech stack, and CDN. Supports matchers,…

UnauthScout is an OSINT (Open Source Intelligence) tool developed in Bash for passive exploration of assets on version control platforms (GitLab and…

Privacy-respecting metasearch engine that aggregates results from multiple search services without tracking or profiling users. Self-hostable with…

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Browser automation framework with a single API for Chromium, Firefox, and WebKit. Supports web testing, scraping, screenshots, and network…

HTTrack Website Copier, copy websites to your computer (Official repository)

Terminal bandwidth utilization tool

Take a list of domains and probe for working HTTP and HTTPS servers

a prettier way to inspect network connections

An active monitoring software to detect failures before your customers do.

The globalping probe code that runs on your hardware and connects to the global community network of probes

CLI to download websites' actual JS/CSS/assets (not flattened HTML)

Tiny embeddable dns server

Command-line tool to scrape and download media (photos, videos, stories) from VKontakte users and communities using the VK API. Supports multiple…

Takes a curl command and explains DNS/TLS/HTTP details step-by-step

LibreDNS website [libredns.gr](https://libredns.gr)