基于Selenium的网页抓取器,用于生成密码列表。
# Download Firefox webdriver from https://github.com/mozilla/geckodriver/releases
$ tar xzf geckodriver-v{VERSION-HERE}.tar.gz
$ sudo mv geckodriver /usr/local/bin # Make sure it is in your PATH
$ geckodriver --version # Make sure webdriver is properly installed
$ git clone https://github.com/dariusztytko/words-scraper
$ sudo pip3 install -r words-scraper/requirements.txt
$ python3 words-scraper.py -o words.txt https://www.example.com https://blog.example.com
如此生成的单词列表可用于执行在线暴力破解攻击或破解密码哈希:
$ hashcat -m 0 hashes.txt words.txt
使用 --depth 选项还可以从链接页面抓取单词。 可选的 --show-gui 开关可用于跟踪进度并快速查看页面:
$ python3 words-scraper.py -o words.txt --depth 1 --show-gui https://www.example.com
生成的单词列表可以通过 words-converter.py 脚本进行扩展。 该脚本会移除特殊字符和重音符号。 示例波兰单词 źdźbło! 将被转换为以下单词:
$ cat words.txt | python3 words-converter.py | sort -u > words2.txt
Twitter页面在滚动时动态加载。 使用 --max-scrolls 选项抓取单词:
$ python3 words-scraper.py -o words.txt --max-scrolls 300 --show-gui https://twitter.com/example.com
$ ssh -D 1080 -Nf {USER-HERE}@{IP-HERE} >/dev/null 2>&
$ python3 words-scraper.py -o words.txt --socks-proxy 127.0.0.1:1080 https://www.example.com
usage: words-scraper.py [-h] [--depth DEPTH] [--max-scrolls MAX_SCROLLS]
[--min-word-length MIN_WORD_LENGTH]
[--page-load-delay PAGE_LOAD_DELAY]
[--page-scroll-delay PAGE_SCROLL_DELAY] [--show-gui]
[--socks-proxy SOCKS_PROXY] -o OUTPUT_FILE
url [url ...]
Words scraper (version: 1.0)
positional arguments:
url URL to scrape
optional arguments:
-h, --help show this help message and exit
--depth DEPTH scraping depth, default: 0
--max-scrolls MAX_SCROLLS
maximum number of the page scrolls, default: 0
--min-word-length MIN_WORD_LENGTH
default: 3
--page-load-delay PAGE_LOAD_DELAY
page loading delay, default: 3.0
--page-scroll-delay PAGE_SCROLL_DELAY
page scrolling delay, default: 1.0
--show-gui show browser GUI
--socks-proxy SOCKS_PROXY
socks proxy e.g. 127.0.0.1:1080
-o OUTPUT_FILE, --output-file OUTPUT_FILE
save words to file
请参见 CHANGELOG