w12scan-client

Network asset search and discovery engine, large-scale asset identification, graduation project, w12scan client program

Design Philosophy

The client's philosophy is to only process the data (url, ip) it receives, without automatically following 301 redirects based on URLs, nor scanning IPs based on URLs. These tasks need to be done before adding targets to the client, for example, adding http://url and https://url along with the corresponding IP, so that w12scan can perform aggregated analysis based on the relevant content.

Configuration Notes

• This is the scanning end of w12scan, written in Python 3. Before scanning, you need to install nmap and masscan and set them as environment variables. Of course, if you install it using Docker compilation, this step is not needed.
• config.py defines the scanning-related configuration. You can set the rate for masscan scanning, whether to scan all ports (partial ports are scanned by default), the number of threads, node names, and more...

Docker Compilation

• All code commits in this repository are automatically compiled and pushed to Docker Hub, so you don't need to download the repository here. You just need to run it as required by https://github.com/boy-hack/w12scan.
• Unless you want to modify some configurations yourself, you can use the following commands in this directory:

$docker build -t w12scan-client:latest .
$docker tag w12scan-client:latest boyhack/w12scan-client

Then run it as required by https://github.com/boy-hack/w12scan.

IP Database Update

• Most IP interfaces on the internet have rate limits, so IP data uses GEOIP data, but the timeliness of the data is not guaranteed. This can be resolved by downloading the latest database.
• https://geolite.maxmind.com/download/geoip/database/GeoLite2-Country.tar.gz
• Place it in the data/GeoLite2 directory.