Log In Sign Up

wikiwand.com
robots.txt

Robots Exclusion Standard data for wikiwand.com

Resource Scan

Scan Details

Site Domain wikiwand.com
Base Domain wikiwand.com
Scan Status Ok
Last Scan2024-05-28T19:31:20+00:00
Next Scan 2024-06-04T19:31:20+00:00

Last Scan

Scanned2024-05-28T19:31:20+00:00
URL https://wikiwand.com/robots.txt
Redirect https://www.wikiwand.com/robots.txt
Redirect Domain www.wikiwand.com
Redirect Base wikiwand.com
Domain IPs 108.156.133.3, 108.156.133.39, 108.156.133.59, 108.156.133.79
Redirect IPs 108.156.133.3, 108.156.133.39, 108.156.133.59, 108.156.133.79
Response IP 108.156.133.79
Found Yes
Hash 67c85e67f31c65dcde7e3e59cc9777ebd8726f79dfdcff94405dbc58ef2b3ebc
SimHash 370a985c1493

Groups

bytespider
semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /api/snippet
Disallow /test
Disallow /admin
Disallow /wiki/
Disallow /w/
Disallow /*/Special%3A
Disallow /*/MediaWiki%3A
Disallow /*/MediaWiki_talk%3A
Disallow /*/Wikipedia%3A
Disallow /*/Wikipedia_talk%3A
Disallow /*/Category%3ANoindexed_pages
Disallow /*/Especial%3A
Disallow /*/Spezial%3A
Disallow /*/Spesial%3A
Disallow /*/Spezial%3A
Disallow /*/Specjalna%3A
Disallow /*/Speciaal%3A
Disallow /*/Speciel%3A
Disallow /*/Speciale%3A
Disallow /*/Istimewa%3A
Disallow /*/Toiminnot%3A
Disallow /*/%D8%AE%D8%A7%D8%B5%3A
Disallow /*/Wikipedia_Diskussion%3A
Disallow /*/K%C3%A4ytt%C3%A4j%C3%A4%3A
Disallow /*/K%C3%A4ytt%C3%A4j%C3%A4%3A
Disallow /*/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4%3A
Disallow /*/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4%3A
Disallow /*/Wikipedia%3AYll%C3%A4pit%C3%A4j%C3%A4t/
Disallow /*/Wikipedia%3AYll%C3%A4pit%C3%A4j%C3%A4t/
Disallow /*/Wikip%C3%A9dia%3A
Disallow /*/%D7%9E%D7%99%D7%95%D7%97%D7%93%3A
Disallow /*/Speci%C3%A1lis%3A
Disallow /*/%E7%89%B9%E5%88%A5%3A
Disallow /*/Discu%C5%A3ie_Wikipedia%3A
Disallow /*/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5%3A
Disallow /*/Wikipedia_Discuss%C3%A3o%3A
Disallow /*/Category%3A%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89
Disallow /*/Category%3A%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89
Disallow /*/Category%3A%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0
Disallow /*/Category%3A%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0
Disallow /*/Categoria%3A
Disallow /*/Wikipedia%3ASospette_violazioni_di_copyright
Disallow /*/Categoria%3ADa_controllare_per_copyright
Disallow /*/Progetto%3ARimozione_contributi_sospetti
Disallow /*/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright
Disallow /*/Progetto%3ACococo
Disallow /*/Discussioni_progetto%3ACococo
Disallow /*/Discussioni_progetto%3ACococo
Disallow /*/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A
Disallow /*/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A
Disallow /*/Anv%C3%A4ndare
Disallow /*/Anv%C3%A4ndare%3A
Disallow /*/Anv%C3%A4ndardiskussion%3A
Disallow /*/Anv%C3%A4ndardiskussion%3A
Disallow /*/Bruker%3A
Disallow /*/Brukerdiskusjon%3A
Disallow /*/Wikipedia-diskusjon%3A
Back to top

Other Records

Field Value
sitemap https://www.wikiwand.com/sitemaps/sitemap.xml
Back to top

Comments

  • =======================================================================================
  • Following are imported robots rules from Wikipedia.org.
  • This is important so search engines will not index pages which shouldn't be indexed
  • e.g. Talk Pages, Special Pages, etc.
  • See: https://en.wikipedia.org/wiki/Wikipedia:Controlling_search_engine_indexing
  • =======================================================================================
  • =====================
  • Internationalization:
  • =====================
  • special pages:
  • ar:
  • de:
  • fi:
  • fr:
  • he:
  • hu:
  • ja:
  • ro:
  • ru:
  • pt:
  • zh:
  • it:
  • he:
  • sv:
  • 11432
Back to top