Log In Sign Up

bg.m.wikipedia.org
robots.txt

Robots Exclusion Standard data for bg.m.wikipedia.org

Resource Scan

Scan Details

Site Domain bg.m.wikipedia.org
Base Domain wikipedia.org
Scan Status Ok
Last Scan2024-05-23T18:18:54+00:00
Next Scan 2024-06-06T18:18:54+00:00

Last Scan

Scanned2024-05-23T18:18:54+00:00
URL https://bg.m.wikipedia.org/robots.txt
Domain IPs 103.102.166.224, 2001:df2:e500:ed1a::1
Response IP 103.102.166.224
Found Yes
Hash d7957b0534fa94a6b14b13a8355596034ccf172ad70ca8118cd07306bff5dd22
SimHash aa9a250944c7

Groups

mj12bot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow /

israbot

Rule Path
Disallow

orthogaffe

Rule Path
Disallow

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fast

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

*

Rule Path
Allow /w/api.php?action=mobileview&
Allow /w/load.php?
Allow /api/rest_v1/?doc
Disallow /w/
Disallow /api/
Disallow /trap/
Disallow /wiki/Special%3A
Disallow /wiki/Spezial%3A
Disallow /wiki/Spesial%3A
Disallow /wiki/Special%3A
Disallow /wiki/Spezial%3A
Disallow /wiki/Spesial%3A
Disallow /wiki/%D8%AE%D8%A7%D8%B5%3ASearch
Disallow /wiki/%D8%AE%D8%A7%D8%B5%3ASearch
Disallow /wiki/Wikipedia%3AL%C3%B6schkandidaten/
Disallow /wiki/Wikipedia%3AL%C3%B6schkandidaten/
Disallow /wiki/Wikipedia%3AVandalensperrung/
Disallow /wiki/Wikipedia%3ABenutzersperrung/
Disallow /wiki/Wikipedia%3AVermittlungsausschuss/
Disallow /wiki/Wikipedia%3AAdministratoren/Probleme/
Disallow /wiki/Wikipedia%3AAdminkandidaturen/
Disallow /wiki/Wikipedia%3AQualit%C3%A4tssicherung/
Disallow /wiki/Wikipedia%3AQualit%C3%A4tssicherung/
Disallow /wiki/Wikipedia%3AVandalismusmeldung/
Disallow /wiki/Wikipedia%3AGesperrte_Lemmata/
Disallow /wiki/Wikipedia%3AL%C3%B6schpr%C3%BCfung/
Disallow /wiki/Wikipedia%3AL%C3%B6schpr%C3%BCfung/
Disallow /wiki/Wikipedia%3AAdministratoren/Notizen/
Disallow /wiki/Wikipedia%3ASchiedsgericht/Anfragen/
Disallow /wiki/Wikipedia%3AL%C3%B6schpr%C3%BCfung/
Disallow /wiki/Wikipedia%3ACheckuser/
Disallow /wiki/Wikipedia_Diskussion%3ACheckuser/
Disallow /wiki/Wikipedia_Diskussion%3AAdminkandidaturen/
Disallow /wiki/Wikipedia%3ASpam-Blacklist-Log
Disallow /wiki/Wikipedia%3ASpam-Blacklist-Log
Disallow /wiki/Wikipedia_Diskussion%3ASpam-Blacklist-Log
Disallow /wiki/Wikipedia_Diskussion%3ASpam-Blacklist-Log
Disallow /wiki/Wikipedia%3AArticles_for_deletion/
Disallow /wiki/Wikipedia%3AArticles_for_deletion/
Disallow /wiki/Wikipedia%3AVotes_for_deletion/
Disallow /wiki/Wikipedia%3AVotes_for_deletion/
Disallow /wiki/Wikipedia%3APages_for_deletion/
Disallow /wiki/Wikipedia%3APages_for_deletion/
Disallow /wiki/Wikipedia%3AMiscellany_for_deletion/
Disallow /wiki/Wikipedia%3AMiscellany_for_deletion/
Disallow /wiki/Wikipedia%3AMiscellaneous_deletion/
Disallow /wiki/Wikipedia%3AMiscellaneous_deletion/
Disallow /wiki/Wikipedia%3ACopyright_problems
Disallow /wiki/Wikipedia%3ACopyright_problems
Disallow /wiki/Wikipedia%3AProtected_titles/
Disallow /wiki/Wikipedia%3AProtected_titles/
Disallow /wiki/Wikipedia%3AWikiProject_Spam/
Disallow /wiki/Wikipedia%3AWikiProject_Spam/
Disallow /wiki/MediaWiki%3ASpam-blacklist
Disallow /wiki/MediaWiki%3ASpam-blacklist
Disallow /wiki/MediaWiki_talk%3ASpam-blacklist
Disallow /wiki/MediaWiki_talk%3ASpam-blacklist
Disallow /wiki/Wikipedia%3ARequests_for_arbitration/
Disallow /wiki/Wikipedia%3ARequests_for_arbitration/
Disallow /wiki/Wikipedia%3ARequests_for_comment/
Disallow /wiki/Wikipedia%3ARequests_for_comment/
Disallow /wiki/Wikipedia%3ARequests_for_adminship/
Disallow /wiki/Wikipedia%3ARequests_for_adminship/
Disallow /wiki/Wikipedia_talk%3AArticles_for_deletion/
Disallow /wiki/Wikipedia_talk%3AArticles_for_deletion/
Disallow /wiki/Wikipedia_talk%3AVotes_for_deletion/
Disallow /wiki/Wikipedia_talk%3AVotes_for_deletion/
Disallow /wiki/Wikipedia_talk%3APages_for_deletion/
Disallow /wiki/Wikipedia_talk%3APages_for_deletion/
Disallow /wiki/Wikipedia_talk%3AMiscellany_for_deletion/
Disallow /wiki/Wikipedia_talk%3AMiscellany_for_deletion/
Disallow /wiki/Wikipedia_talk%3AMiscellaneous_deletion/
Disallow /wiki/Wikipedia_talk%3AMiscellaneous_deletion/
Disallow /wiki/Wikipedia%3AChanging_username
Disallow /wiki/Wikipedia%3AChanging_username
Disallow /wiki/Wikipedia%3AChanging_username/
Disallow /wiki/Wikipedia%3AChanging_username/
Disallow /wiki/Wikipedia_talk%3AChanging_username
Disallow /wiki/Wikipedia_talk%3AChanging_username
Disallow /wiki/Wikipedia_talk%3AChanging_username/
Disallow /wiki/Wikipedia_talk%3AChanging_username/
Disallow /wiki/Wikipedia%3AConsultas_de_borrado/
Disallow /wiki/Wikipedia%3AConsultas_de_borrado/
Disallow /wiki/Wikipedia%3APoistettavat_sivut
Disallow /wiki/K%C3%A4ytt%C3%A4j%C3%A4%3A
Disallow /wiki/K%C3%A4ytt%C3%A4j%C3%A4%3A
Disallow /wiki/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4%3A
Disallow /wiki/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4%3A
Disallow /wiki/Wikipedia%3AYll%C3%A4pit%C3%A4j%C3%A4t/
Disallow /wiki/Wikipedia%3AYll%C3%A4pit%C3%A4j%C3%A4t/
Disallow /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93%3ASearch
Disallow /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93%3ASearch
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
Disallow /wiki/Speci%C3%A1lis%3ASearch
Disallow /wiki/Speci%C3%A1lis%3ASearch
Disallow /wiki/Wikipedia%3APagine_da_cancellare
Disallow /wiki/Wikipedia%3APagine_da_cancellare
Disallow /wiki/Wikipedia%3AUtenti_problematici
Disallow /wiki/Wikipedia%3AUtenti_problematici
Disallow /wiki/Wikipedia%3AVandalismi_in_corso
Disallow /wiki/Wikipedia%3AVandalismi_in_corso
Disallow /wiki/Wikipedia%3AAmministratori
Disallow /wiki/Wikipedia%3AAmministratori
Disallow /wiki/Wikipedia%3AProposte_di_cancellazione_semplificata
Disallow /wiki/Wikipedia%3AProposte_di_cancellazione_semplificata
Disallow /wiki/Categoria%3ADa_cancellare_subito
Disallow /wiki/Categoria%3ADa_cancellare_subito
Disallow /wiki/Wikipedia%3ASospette_violazioni_di_copyright
Disallow /wiki/Wikipedia%3ASospette_violazioni_di_copyright
Disallow /wiki/Categoria%3ADa_controllare_per_copyright
Disallow /wiki/Categoria%3ADa_controllare_per_copyright
Disallow /wiki/Progetto%3ARimozione_contributi_sospetti
Disallow /wiki/Progetto%3ARimozione_contributi_sospetti
Disallow /wiki/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright
Disallow /wiki/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright
Disallow /wiki/Progetto%3ACococo
Disallow /wiki/Progetto%3ACococo
Disallow /wiki/Discussioni_progetto%3ACococo
Disallow /wiki/Discussioni_progetto%3ACococo
Disallow /wiki/%E7%89%B9%E5%88%A5%3ASearch
Disallow /wiki/%E7%89%B9%E5%88%A5%3ASearch
Disallow /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/
Disallow /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/
Disallow /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
Disallow /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
Disallow /wiki/Bruker%3A
Disallow /wiki/Bruker%3A
Disallow /wiki/Brukerdiskusjon
Disallow /wiki/Wikipedia%3AAdministratorer
Disallow /wiki/Wikipedia%3AAdministratorer
Disallow /wiki/Wikipedia-diskusjon%3AAdministratorer
Disallow /wiki/Wikipedia-diskusjon%3AAdministratorer
Disallow /wiki/Wikipedia%3ASletting
Disallow /wiki/Wikipedia%3ASletting
Disallow /wiki/Wikipedia-diskusjon%3ASletting
Disallow /wiki/Wikipedia-diskusjon%3ASletting
Disallow /wiki/Wikipedia%3AStrony_do_usuni%C4%99cia
Disallow /wiki/Wikipedia%3AStrony_do_usuni%C4%99cia
Disallow /wiki/Wikipedia%3ADo_usuni%C4%99cia
Disallow /wiki/Wikipedia%3ADo_usuni%C4%99cia
Disallow /wiki/Wikipedia%3ASDU/
Disallow /wiki/Wikipedia%3ASDU/
Disallow /wiki/Wikipedia%3AStrony_podejrzane_o_naruszenie_praw_autorskich
Disallow /wiki/Wikipedia%3AStrony_podejrzane_o_naruszenie_praw_autorskich
Disallow /wiki/Wikipedia%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia_Discuss%C3%A3o%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia_Discuss%C3%A3o%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia_Discuss%C3%A3o%3AP%C3%A1ginas_para_eliminar/
Disallow /wiki/Wikipedia%3APagini_de_%C5%9Fters
Disallow /wiki/Wikipedia%3APagini_de_%C5%9Fters
Disallow /wiki/Discu%C5%A3ie_Wikipedia%3APagini_de_%C5%9Fters
Disallow /wiki/Discu%C5%A3ie_Wikipedia%3APagini_de_%C5%9Fters
Disallow /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5%3ASearch
Disallow /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5%3ASearch
Disallow /wiki/Wikipedia%3ASidor_f%C3%B6reslagna_f%C3%B6r_radering
Disallow /wiki/Wikipedia%3ASidor_f%C3%B6reslagna_f%C3%B6r_radering
Disallow /wiki/Wikipedia%3ASidor_f%C3%B6reslagna_f%C3%B6r_radering
Disallow /wiki/Anv%C3%A4ndare
Disallow /wiki/Anv%C3%A4ndare
Disallow /wiki/Anv%C3%A4ndardiskussion
Disallow /wiki/Anv%C3%A4ndardiskussion
Disallow /wiki/Wikipedia%3ASkyddade_sidnamn
Disallow /wiki/Wikipedia%3ASkyddade_sidnamn
Disallow /wiki/Wikipedia%3ASidor_som_b%C3%B6r_raderas
Disallow /wiki/Wikipedia%3ASidor_som_b%C3%B6r_raderas
Disallow /wiki/Wikipedia%3ASidor_som_b%C3%B6r_raderas
Disallow /wiki/Wikipedia%3A%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8/%E4%BE%B5%E6%9D%83
Disallow /wiki/Wikipedia%3A%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8/%E4%BE%B5%E6%9D%83
Disallow /wiki/Wikipedia%3A%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8%E5%92%8C%E8%AF%B7%E6%B1%82
Disallow /wiki/Wikipedia%3A%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8%E5%92%8C%E8%AF%B7%E6%B1%82
Disallow /wiki/Category%3A%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89
Disallow /wiki/Category%3A%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89
Disallow /wiki/Category%3A%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0
Disallow /wiki/Category%3A%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0
Disallow /wiki/Portal%3APrepared_stories/
Disallow /wiki/Portal%3APrepared_stories/
Disallow /wiki/Wikinotizie%3ARichieste_di_cancellazione
Disallow /wiki/Wikinotizie%3ASospette_violazioni_di_copyright
Disallow /wiki/Categoria%3ADa_cancellare_subito
Disallow /wiki/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright
Disallow /wiki/Wikinotizie%3AStorie_in_preparazione
Disallow /wiki/Wikiquote%3AVotes_for_deletion/
Disallow /wiki/Wikiquote%3AVotes_for_deletion/
Disallow /wiki/Wikiquote_talk%3AVotes_for_deletion/
Disallow /wiki/Wikiquote_talk%3AVotes_for_deletion/
Disallow /wiki/Wikiquote%3AVotes_for_deletion_archive/
Disallow /wiki/Wikiquote%3AVotes_for_deletion_archive/
Disallow /wiki/Wikiquote_talk%3AVotes_for_deletion_archive/
Disallow /wiki/Wikiquote_talk%3AVotes_for_deletion_archive/
Disallow /wiki/Wikibooks%3AVotes_for_deletion
Disallow /wiki/Fundraising_2007/comments
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-blacklist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-whitelist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-whitelist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8%3ASpam-whitelist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-whitelist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-whitelist
Disallow /wiki/%D0%9C%D0%B5%D0%B4%D0%B8%D1%8F%D0%A3%D0%B8%D0%BA%D0%B8_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3ASpam-whitelist
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%3A
Disallow /wiki/User%3A
Disallow /wiki/User%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/User%20talk%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/User%20talk%3A
Disallow /wiki/%D0%A3%3A%D0%A1%D0%98
Disallow /wiki/%D0%A3%3A%D0%A1%D0%98
Disallow /wiki/%D0%A3%3A%D0%A1%D0%98
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project_talk%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project_talk%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project_talk%3A%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B8_%D0%B7%D0%B0_%D0%B8%D0%B7%D1%82%D1%80%D0%B8%D0%B2%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%3A%D0%9E%D0%9F%D0%A0
Disallow /wiki/%D0%A3%3A%D0%9E%D0%9F%D0%A0
Disallow /wiki/%D0%A3%3A%D0%9E%D0%9F%D0%A0
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project_talk%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/Project_talk%3A%D0%9E%D1%82%D0%BD%D0%B5%D0%BC%D0%B0%D0%BD%D0%B5_%D0%BD%D0%B0_%D0%BF%D1%80%D0%B0%D0%B2%D0%B0%D1%82%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B5%D0%B4%D0%B0%D0%BA%D1%82%D0%B8%D1%80%D0%B0%D0%BD%D0%B5
Disallow /wiki/%D0%A3%3A%D0%A5
Disallow /wiki/%D0%A3%3A%D0%A5
Disallow /wiki/%D0%A3%3A%D0%A5
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/Project%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/Project%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/Project%3A%D0%A5%D1%83%D0%BC%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/Wikipedia%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/Wikipedia%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/Wikipedia%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%98%D0%BD%D0%BA%D1%83%D0%B1%D0%B0%D1%82%D0%BE%D1%80
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A0%D0%B0%D0%B7%D0%B3%D0%BE%D0%B2%D0%BE%D1%80%D0%B8/%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D0%BD%D0%B0_%D1%82%D0%B5%D1%80%D0%B8%D1%82%D0%BE%D1%80%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A0%D0%B0%D0%B7%D0%B3%D0%BE%D0%B2%D0%BE%D1%80%D0%B8/%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D0%BD%D0%B0%20%D1%82%D0%B5%D1%80%D0%B8%D1%82%D0%BE%D1%80%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A0%D0%B0%D0%B7%D0%B3%D0%BE%D0%B2%D0%BE%D1%80%D0%B8/%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D0%BD%D0%B0_%D1%82%D0%B5%D1%80%D0%B8%D1%82%D0%BE%D1%80%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A0%D0%B0%D0%B7%D0%B3%D0%BE%D0%B2%D0%BE%D1%80%D0%B8/%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D0%BD%D0%B0_%D1%82%D0%B5%D1%80%D0%B8%D1%82%D0%BE%D1%80%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8%20%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB%20%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8%20%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%9F%D0%BE%D1%80%D1%82%D0%B0%D0%BB_%D0%B1%D0%B5%D1%81%D0%B5%D0%B4%D0%B0%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8%20%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Disallow /wiki/%D0%A3%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F%3A%D0%A2%D0%B5%D0%BA%D1%83%D1%89%D0%B8_%D1%81%D1%8A%D0%B1%D0%B8%D1%82%D0%B8%D1%8F
Back to top

Comments

  • robots.txt for http://www.wikipedia.org/ and friends
  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there that go _way_ too fast. If you're
  • irresponsible, your access to the site may be blocked.
  • Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN
  • and ignoring 429 ratelimit responses, claims to respect robots:
  • http://mj12bot.com/
  • advertising-related bots:
  • Wikipedia work bots:
  • Crawlers that are kind enough to obey, but which we'd rather not have
  • unless they're feeding search engines.
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • Misbehaving: requests much too fast:
  • Sorry, wget in its recursive mode is a frequent problem.
  • Please read the man page and use it properly; there is a
  • --wait option you can use to set the delay between hits,
  • for instance.
  • The 'grub' distributed client has been *very* poorly behaved.
  • Doesn't follow robots.txt anyway, but...
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/
  • Friendly, low-speed bots are welcome viewing article pages, but not
  • dynamically-generated pages please.
  • Inktomi's "Slurp" can read a minimum delay between hits; if your
  • bot supports such a thing using the 'Crawl-delay' or another
  • instruction, please let us know.
  • There is a special exception for API mobileview to allow dynamic
  • mobile web & app views to load section content.
  • These views aren't HTTP-cached but use parser cache aggressively
  • and don't expose special: pages etc.
  • Another exception is for REST API documentation, located at
  • /api/rest_v1/?doc.
  • ar:
  • dewiki:
  • T6937
  • sensible deletion and meta user discussion pages:
  • 4937#5
  • T14111
  • T15961
  • enwiki:
  • Folks get annoyed when VfD discussions end up the number 1 google hit for
  • their name. See T6776
  • T15398
  • T16075
  • T13261
  • T12288
  • T16793
  • eswiki:
  • T8746
  • fiwiki:
  • T10695
  • hewiki:
  • T11517
  • huwiki:
  • itwiki:
  • T7545
  • jawiki
  • T7239
  • nowiki
  • T13432
  • plwiki
  • T10067
  • ptwiki:
  • T7394
  • rowiki:
  • T14546
  • ruwiki:
  • svwiki:
  • T12229
  • T13291
  • zhwiki:
  • T7104
  • sister projects
  • enwikinews:
  • T7340
  • itwikinews
  • T11138
  • enwikiquote:
  • T17095
  • enwikibooks
  • working...
  • ----------------------------------------------------------
  • <!-- Моля не премахвайте интервала в началото на този ред, тъй като ще се обърка изгледът на тази страница. http://www.robotstxt.org/orig.html указва, че е допустимо да има интервали преди коментарите. --><pre>
  • На тази страница може да бъдат добавяни директиви, които да станат част от глобалния robots.txt.
  • Страницата трябва да следва формата, описан тук: http://www.robotstxt.org/robotstxt.html
  • Крайният резултат може да бъде проверен тук: https://bg.wikipedia.org/robots.txt
  • Имайте предвид, че промените няма да бъдат отразени незабавно, а след време.
  • ВАЖНО: След като промените бъдат отразени, проверете коректността на новия robots.txt, например чрез
  • http://tools.seochat.com/tools/robots-txt-validator/ като въведете https://bg.wikipedia.org/robots.txt
  • Имайте предвид, че проверката обхваща пълния robots.txt, в който има много други записи освен нашите, и
  • затова не всички грешки и предупреждения са причинени от нас. Обръщайте внимание за кои редове се отнасят.
  • Грешката в първия ред например е очаквана. Нашите локални записи са добавени накрая.
  • ВАЖНО: Не оставяйте празни редове. За визуално отделяне на елементите, използвайте „#“ в началото на реда.
  • Редове, които започват с „#“, могат да имат произволно съдържание и може да бъдат използвани за коментари.
  • Имайте предвид, че при обичайно показване може да изглежда сякаш след особено дълъг ред следва празен.
  • Това е само козметичен проблем. Същественото е да няма празни редове в режим на редактиране.
  • Анти-спам списъци
  • Потребител:
  • Потребител беседа:
  • Страници за изтриване
  • Беседи на страници за изтриване
  • Отнемане на правата за редактиране
  • Беседи на Отнемане на правата за редактиране
  • Уикипедия:Хумор
  • Експериментални страници: Инкубатор, Свободна територия, Текущи събития и т.н.
  • Спорни статии и страници
  • Disallow: /wiki/...
  • ВАЖНО: Добавяйте нови записи само над този ред. Не забравяйте да не оставяте празни редове. ###</pre>
Back to top