
Crawler (Bot) searching for leaks on paste sites.

v3.1.0 — CHANGELOG
Multi-source OSINT credential-leak crawler for paste sites.
FOR RESEARCH ONLY. This tool is intended for researchers and defenders to detect exposed secrets on public paste sites before attackers exploit them. Do not host or distribute breach data.
Want to analyze collected pastes or a lot of other plaintext files? Use my project BlackSignal
| Source | Method | Flag |
|---|---|---|
| Pastebin archive | polls https://pastebin.com/archive for new pastes | -a |
| Pastebin user track | follows users from configs/users.txt | -t |
| Pastes.io | random 8-char ID guesses against the JSON API | -p |
| GitHub Gists | polls https://gist.github.com/discover for new gists | -g |
| Dpaste.com | polls https://dpaste.com/public/ | -d |
| Pastecode.io | polls https://pastecode.io/archive | -c |
| GitLab snippets | polls https://gitlab.com/explore/snippets | -l |
| Ideone.com | polls https://ideone.com/recent | -i |
| paste.gg | polls https://api.paste.gg/v1/pastes | -s |
Additional: -D for the web dashboard, -e/-u to edit search terms/users.
./setup.sh
Or manually:
pip install -r requirements.txt
Required: Python 3, tmux, vi, openssl. See setup.sh for details.
Start scrapers via the control script:
python3 scavenger.py -a -t
Each flag launches a scraper in a detached tmux session. You can combine multiple flags.
List sessions:
tmux ls
Attach to a running scraper:
tmux a -t s-pastebin-archive
Detach with Ctrl+B d.
Scripts can also be run directly:
python3 scrapers/scraper_pastebin_archive.py
python3 scavenger.py -D
HTTPS at https://127.0.0.1:8080, auto-refreshes every 30s.
configs/searchterms.txt — one substring per line. Email:password detection is always on.configs/users.txt — target usernames for pastebin (one per line).configs/pastesio.json — pastes.io API key (optional) and tier ("free" or "pro").data/
├── raw_pastes/ # All downloaded pastes
├── files_with_passwords/ # Pastes where passwords have been found
└── otherSensitivePastes # Pastes with other sensitive data definded by searchterms.txt
As soon as the number of raw pastes for a source exceed 48000 files, they get zipped and moved to
archive/.
| File | Purpose |
|---|---|
scavenger.py | Control script - launches modules via tmux |
classes/utility.py | Shared helpers: detection, database, archive, scraper loop |
scraper_*.py | One scraper per source |
dashboard.py | Web dashboard |
setup.sh | Setup to create dirs and install dependencies |
MIT © rndinfosecguy
This software is provided for educational and research purposes only. Users are solely responsible for compliance with applicable laws and terms of service of any data source. Do not use this tool to store or distribute stolen data.