Crawler

tacone/prosey

Download YouTube transcripts

nekmo/dirhunt

Find web directories without bruteforce

1tayh/noisy

Simple random DNS, HTTP/S internet traffic noise generator

vida-nyu/ache

Focused web crawler that uses page classifiers and link prioritization to efficiently collect domain-specific or pattern-matching web pages, with…

batuhaniskr/twitter-intelligence

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

xillwillx/skiptracer

OSINT python webscaping framework

0xinfection/xsrfprobe

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

0xprateek/stardox

Github stargazers information gathering tool

rndinfosecguy/scavenger

Crawler (Bot) searching for credential leaks on paste sites.

kahunalu/pwnbin

Python Pastebin Webcrawler that returns list of public pastebins containing keywords

menkrep1337/xsscon

XSSCon: Simple XSS Scanner tool

anouarbensaad/vulnx

vulnx 🕷️ an intelligent Bot, Shell can achieve automatic injection, and help researchers detect security vulnerabilities CMS system. It can perform…

soheilkhodayari/jaw

JAW: A Graph-based Security Analysis Framework for Client-side JavaScript

al0ne/vxscan

python3写的综合扫描工具，主要用来存活验证，敏感文件探测(目录扫描/js泄露接口/html注释泄露)，WAF/CDN识别，端口扫描，指纹/服务识别，操作系统识别，POC扫描，SQL注入，绕过CDN，查询旁站等功能，主要用来甲方自测或乙方授权测试，请勿用来搞破坏。

silverpoision/rock-on

Rock-On is a all in one Recon tool that will just get a single entry of the Domain name and do all of the work alone.

itsmehacker/darkscrape

OSINT Tool For Scraping Dark Websites

dirtyfilthy/freshonions-torscraper

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion