xnLinkFinder

About - v8.2

This is a tool used to discover endpoints, discover potential parameters, generate a target specific wordlist and find secrets for a given target. It can find them by:

• crawling a target (pass a domain/URL)
• crawling multiple targets (pass a file of domains/URLs)
• searching files in a given directory (pass a directory name)
• search a single file's contents
• get them from a Burp project (pass location of a Burp XML file)
• get them from an ZAP project (pass location of a ZAP ASCII message file)
• get them from a Caido project (pass location of a Caido export CSV file)
• get them from a HAR (HTTP Archive) file (pass location of a HAR JSON file)
• processing a waymore results directory (searching archived response files from waymore -mode R and also requesting URLs from waymore.txt and the original URLs from waymore_index.txt - see waymore README.md)

The python script is based on the link finding capabilities of my Burp extension GAP. As a starting point, I took the amazing tool LinkFinder by Gerben Javado, and used the Regex for finding links, but with additional improvements to find even more.

Installation

xnLinkFinder supports Python 3.

Install xnLinkFinder in default (global) python environment.

pip install xnLinkFinder

OR

pip install git+https://github.com/xnl-h4ck3r/xnLinkFinder.git -v

You can upgrade with

pip install --upgrade xnLinkFinder

pipx

Quick setup in isolated python environment using pipx

pipx install git+https://github.com/xnl-h4ck3r/xnLinkFinder.git

NOTE: To extract links from PDF files, you can install pdftotext on your system. You can install it using sudo apt install -y poppler-utils on Linux or brew install poppler on macOS. If you don't have pdftotext installed, xnLinkFinder will fall back to using the pypdf Python library. If no text is found (e.g. for scanned PDFs), it will attempt to use ocrmypdf if installed (e.g. sudo apt install -y ocrmypdf). Using pdftotext and ocrmypdf will generally give much better results than pypdf alone.

Usage