
Fucking Search Engines Scraper - 검색 엔진에서 URL을 스크래핑하는 파이썬 라이브러리
Fucking Search Engines Scraper - 검색 엔진에서 URL을 스크래핑하는 파이썬 라이브러리
Ask Bing DuckDuck GO UOL Yahoo
git clone https://github.com/mthbernardes/fses.git cd fses pip install -r requeriments.txt
Ask를 사용한 간단한 검색
from searchEngines.ask import ask
print "Ask Search"
query = "site:domain.com" # Set a dork
a = ask() # Start a instance of any search engine
results = a.search(query,verbose=True) #All classes use the method search, verbose is used just to print, what page the script is scraping
for url in results
print url
모든 검색 엔진 메서드
query = "site:domain.com"
from searchEngines.ask import ask
print "Ask Search"
results.extend(ask().search(query,verbose=verbose))
from searchEngines.uol import uol
print "UOL Search"
results.extend(uol().search(query,verbose=verbose))
from searchEngines.bing import bing
print "Bing Search"
results.extend(bing().search(query,verbose=verbose))
from searchEngines.yahoo import yahoo
print "Yahoo Search"
results.extend(yahoo().search(query,verbose=verbose))
from searchEngines.duckduckgo import duckDuckGo
print "DuckDuckGo Search"
results.extend(duckDuckGo().search(query,verbose=verbose))
모든 검색 엔진을 사용한 검색
from utils import util
query = "site:conviso.com.br"
results = util.searchAll(query,verbose=False) #searchAll has the same properties then search method
for url in results
print url
다른 검색 엔진용 플러그인을 만드는 방법에 대한 템플릿인 searchEngines/example.py를 참고하세요.