
ð - Torãããã¯ãŒã¯äžã®ãµã€ããã¯ããŒã«ããããŒã¯ãŒããæ€çŽ¢ããŸãã
torãããã¯ãŒã¯äžã®ãµã€ããã¯ããŒã«ããããŒã¯ãŒããæ€çŽ¢ããŸãã
VigilantOnionã¯ããµã€ããŒè åšã€ã³ããªãžã§ã³ã¹ããŒã ãtorãããã¯ãŒã¯äžã§å®æœãã調æ»ãç£èŠããæè¯ã®çµæãåŸãããããæ¯æŽããããã«è£å®ããããŒã«ã§ãã
管çãšããã·ã¥ããŒãäœæã«djangoã䜿çšããæåã®ããŒãžã§ã³ã§ã¯ãå©çšãéåžžã«å°é£ã§ããããã®æ°ããããŒãžã§ã³ã§ã¯ã調æ»ãšã誀æ€ç¥ãæé€ããããã®ææ³ãæ¹åãããŠããŸãã
誀æ€ç¥ãæé€ããæ£ç¢ºæ§ã®ã¬ãã«ãåäžãããããã«ãç§ã¯yararuleãšããŒãã䜿çšããæãé¢é£æ§ãé«ããšå€æããã«ãŒã«ã«ã¯é«ãå€ãèšå®ããŠããŸãã以äžã®å³ã«ç€ºããšããã§ã:

ãããã®å€ã¯åçã§ãããå¿ èŠã«å¿ããŠå€æŽã§ããŸãã
æ°ããyararuleã¯ã«ããŽãªãã¡ã€ã«ãšããŒã¯ãŒããã¡ã€ã«ã®äž¡æ¹ã«è¿œå ã§ããããã誀æ€ç¥ãæé€ããããå¿«é©ãªçµæãåŸãããšãã§ããŸãã
èšå®ãã¡ã€ã«ã§å€æŽããå¿ èŠãããé ç®ã¯ãããã§ãããã¹ã¯ãªããã䜿çšããäžã§éåžžã«éèŠã§ãã
以äžã®ãã£ãŒã«ãã¯torãããã¯ãŒã¯ãããã·ãèšå®ããããã®ãã®ã§ããWindowsã§ã¹ã¯ãªãããå®è¡ããŠããå ŽåãããŒãã¯éåžž9051ã«å€ãããŸãã
server_proxy: localhost
port_proxy: 9050
type_proxy: socks5h
timeoutãµãŒããŒãã£ãŒã«ãã¯ããªã¯ãšã¹ããåŸ æ©ããæéãæ±ºå®ããããã®ãã®ã§ããæéãé·ãã»ã©ãã¹ã¯ãªããã®å®è¡ã«æéããããå ŽåããããŸãã
timeout: 30
scoreãµãŒããŒãã£ãŒã«ãã¯ãURLãã¯ããŒã«ããsyslogã«éä¿¡ãããããã®æå°ã¹ã³ã¢å€ã決å®ããããã®ãã®ã§ãã
score_categorie: 20
score_keywords: 40
äžéšã®URLã¯ãªãã©ã€ã³ã«ãªã£ãŠããã埩æ§ãããã©ããã倿ããã®ã¯å°é£ã§ãããã®ãããæå€§è©Šè¡åæ°ã決å®ã§ããã«ãŠã³ã¿ãŒãäœæããŸããããã®åæ°ã«éãããšãã¹ã¯ãªããã¯ãã®URLãžã®ã¢ã¯ã»ã¹ã詊ã¿ãªããªããŸãã
count_categories: 5
URLãã¯ããŒã«ããããã³ã«ããã®æåŸã®ã¹ãã£ã³æ¥æãšãšãã«ä¿åãããŸããåãURLã«å¯ŸããŠãããã¹ãã£ã³ã𿬡ã®ã¹ãã£ã³ã®éã®æ¥æ°å¶éãèšå®ã§ããŸãã
daystime: 10
ãããŠæåŸã«ãç§ã¯ãã¯ãdjangoã䜿çšããŠããŸãããçµæã衚瀺ããã«ã¯SplunkãELKãªã©ã®syslogãå¿ èŠã§ãããããã§ããããå®çŸ©ããã ãã§ãã
sendlog: True
logport: 5151
logip: "localhost"
äœ¿çšæ¹æ³ã¯ããã·ã³ãã«ã§ããtorãšPythonã©ã€ãã©ãªãã€ã³ã¹ããŒã«ãããŠããå¿ èŠãããã ãã§ãããã®ããã«ã¯ã以äžã®ã³ãã³ããå®è¡ããŠãã ãã:
pip install -r requirements.txt
torã¯ã©ã€ã¢ã³ããšã©ã€ãã©ãªãã€ã³ã¹ããŒã«ããåŸã--helpã³ãã³ãã䜿çšããŠäœ¿ç𿹿³ã®è©³çްã確èªããŠãã ããã
â python3 observer.py -h
usage: observer.py [-h] [--config CONFIG] [--crawler] [--url URL] [--search]
[--engines ENGINES] [--find FIND] [--pastebin PASTEBIN]
VigilantOnion is a script to collect as many sites from the onion network as
possible and add them to a database. With all possible sites collected, a
crawler will be created so that we can monitor the search for keywords defined
by you.
optional arguments:
-h, --help show this help message and exit
--config CONFIG, -c CONFIG
Configuration file in yaml format
--crawler Starts the TOR network URL crawler process.
--url URL, -u URL Specifies the URL to crawl.
--search Start the URL search process on the surface. Select a
framework where you want to search for urls.
--engines ENGINES, -e ENGINES
Validates the available engines for searching URLs.
--find FIND, -f FIND Search for arguments on .onion network research sites
--pastebin PASTEBIN Search for .onion urls in pastebin paste.
You can also develop new framework so that the database has more urls onions.
ã¹ã¯ãªãããåäœãããã«ã¯æ°ããURLãå¿ èŠã§ããããã®ããã«ä»¥äžã®äŸã®ããã«è¡šé¢ãæ€çŽ¢ããŠURLãæ¢ãã¡ãœãããäœæããŸããïŒ
python3.6 observer.py --config config/config.yml --search -e "gist,reddit,cybersecuritynews,discoverdarkwebservice"
以äžã®äŸã®ããã«ãpastebin ãã¡ã€ã«ããçŽæ¥URLãååŸããããšãã§ããŸãïŒ
python3.6 observer.py --config config/config.yml --search --pastebin "s7TPZCKz,kSaYqtVX,0GYEEApe,3qkqyqiM,RfgBLg5Q,gtksBij4,FpPzQKHg,wB0uh00r,jDGJhQCC,q6DZ9U,ac2TnUjY,pv4xRWXQ,PgLUE7pF,9XW5Pc7R,hqyGMi7e,UZRM2z8y,7tQvV5CU,9JhVq3H3,Cb5HTydt,kMW5wp3N,v5Yq66sH,2q3SsR3a,gnd8jx97,QwSJYhYF,iNydrDfe"
ããã€ãã®URLãåéããããã¯ããŒã©ãŒããã»ã¹ãéå§ã§ããŸãã æåã®å®è¡ãæãæéããããããšã«æ³šæããŠãã ãããããã¯ããŠã§ããµã€ãã³ã³ãã³ãã®åé¡ãšã«ããŽãªåãããã§è¡ãããããã§ãã
python3.6 observer.py --config config/config.yml --crawler
åäžã®URLãã¯ããŒã«ãããå Žåã¯ã以äžã䜿çšããŸãïŒ
python3.6 observer.py --config config/config.yml --crawler --url "76qugh5bey5gum7l.onion"
çµæã®åºåã¯jsonã§ãããåããã©ãŒãããã§éžæããsyslogã«éä¿¡ãããŸãã
{
"lastscan": "2020-06-29",
"id": 10760,
"type": "URI",
"url": "lolitmhfkpif7sky.onion",
"title": "Lolita Club",
"baseurl": "vyqi2nm36otufrgg.onion",
"status": "Online",
"count_status": 0,
"source": "Script",
"categorie": [
{
"full_categorie": [
"no_match"
],
"score_categorie": 0
}
],
"keywords": [
{
"full_keywords": [
"no_match"
],
"score_keywords": 0
}
],
"discovery_date": "2020-06-29 14:24"
}
ç§ã¯Splunkã䜿çšããŠãããããªãã®ããã·ã¥ããŒããç§ã®ãã®ãšåãããã«èŠããããšãã§ããŸãïŒ

ãããžã§ã¯ãã«ååããããã«ãèªç±ã«ãã©ãŒã¯ããããissueãéããŠãã ããã
ã³ãã¥ããã£ã§æã䜿ãããŠããããŒã«ãèŠã€ããŸãããã
ãŸã 人æ°ããŒã¿ããããŸããã
ãã¹ãŠã®ããŒã«ãæ¢çŽ¢
ããŒã«ã³ã¬ã¯ã·ã§ã³ãé²èЧ
ãã¹ãŠã®ããŒã«ãèŠã â