Web crawling, scraping, spidering, and automated reconnaissance tools for security testing.
albintouma/iran-war-mediaIran War Media Monitor collects news articles covering the US-Israeli war on Iran and applies sentiment analysis to uncover who supports and opposes…
yora1928/cve-2026-15748Scans WordPress Forminator for CVE-2026-15748 unauthenticated RCE. Detects vulnerable sites, crawls forms, extracts nonces, runs safe upload tests.
koala73/worldmonitorReal-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational…
naibowang/easyspiderA visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
searxng/searxngPrivacy-respecting metasearch engine that aggregates results from multiple search services without tracking or profiling users. Self-hostable with…
dgtlmoon/changedetection.ioBest and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price…
scrapegraphai/scrapegraph-aiPython scraper based on AI
qeeqbox/social-analyzerAPI, CLI, and Web App for analyzing and finding a person's profile in 1000 social media \ websites
projectdiscovery/katanaA next-generation crawling and spidering framework.
twintproject/twintAn advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following,…
s0md3v/photonIncredibly fast crawler designed for OSINT.
instaloader/instaloaderDownload pictures (or videos) along with their captions and other metadata from Instagram.
projectdiscovery/nuclei-templatesCommunity curated list of templates for the nuclei engine to find security vulnerabilities.
bigbodycobain/shadowbrokerReal-time geospatial OSINT platform aggregating 60+ public telemetry feeds (ADS-B, AIS, satellites, CCTV) into a unified map with server-side recon…
