
Fucking Search Engines Scraper - biblioteca Python para raspar URLs de motores de busca
Fucking Search Engines Scraper - biblioteca python para raspar URLs de motores de busca
Ask Bing DuckDuck GO UOL Yahoo
git clone https://github.com/mthbernardes/fses.git cd fses pip install -r requeriments.txt
Pesquisa simples usando Ask
from searchEngines.ask import ask
print "Ask Search"
query = "site:domain.com" # Set a dork
a = ask() # Start a instance of any search engine
results = a.search(query,verbose=True) #All classes use the method search, verbose is used just to print, what page the script is scraping
for url in results
print url
Todos os métodos dos motores de busca
query = "site:domain.com"
from searchEngines.ask import ask
print "Ask Search"
results.extend(ask().search(query,verbose=verbose))
from searchEngines.uol import uol
print "UOL Search"
results.extend(uol().search(query,verbose=verbose))
from searchEngines.bing import bing
print "Bing Search"
results.extend(bing().search(query,verbose=verbose))
from searchEngines.yahoo import yahoo
print "Yahoo Search"
results.extend(yahoo().search(query,verbose=verbose))
from searchEngines.duckduckgo import duckDuckGo
print "DuckDuckGo Search"
results.extend(duckDuckGo().search(query,verbose=verbose))
Pesquisar usando todos os motores de busca
from utils import util
query = "site:conviso.com.br"
results = util.searchAll(query,verbose=False) #searchAll has the same properties then search method
for url in results
print url
Basta seguir o searchEngines/example.py, é um modelo de como criar um plugin para outro motor de busca.