Log In Sign Up

osrs.wiki
robots.txt

Robots Exclusion Standard data for osrs.wiki

Resource Scan

Scan Details

Site Domain osrs.wiki
Base Domain osrs.wiki
Scan Status Ok
Last Scan2025-10-16T20:55:23+00:00
Next Scan 2025-11-15T20:55:23+00:00

Last Scan

Scanned2025-10-16T20:55:23+00:00
URL https://osrs.wiki/robots.txt
Redirect https://oldschool.runescape.wiki/robots.txt
Redirect Domain oldschool.runescape.wiki
Redirect Base runescape.wiki
Domain IPs 104.21.57.52, 172.67.141.247, 2606:4700:3031::ac43:8df7, 2606:4700:3033::6815:3934
Redirect IPs 104.20.39.105, 172.66.165.40, 2606:4700:10::6814:2769, 2606:4700:10::ac42:a528
Response IP 104.20.39.105
Found Yes
Hash 4559ae4cafb88524c837cb5d925c3a13d3af0d82cc46c32d0d7ce833ef47cbca
SimHash 50160852cc85

Groups

*

Rule Path
Disallow /w/Bucket%3A
Disallow /w/Bucket%3A
Disallow /w/bucket%3A
Disallow /*?title=Bucket%3A
Disallow /*?title=Bucket%3A
Disallow /*?*&title=Bucket%3A
Disallow /*?*&title=Bucket%3A
Disallow /w/Bucket_talk%3A
Disallow /w/Bucket_talk%3A
Disallow /w/bucket_talk%3A
Disallow /*?title=Bucket_talk%3A
Disallow /*?title=Bucket_talk%3A
Disallow /*?*&title=Bucket_talk%3A
Disallow /*?*&title=Bucket_talk%3A
Disallow /w/Special%3A
Disallow /w/Special%3A
Disallow /w/special%3A
Disallow /*?title=Special%3A
Disallow /*?title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /api.php
Disallow /cdn-cgi/
Disallow /cors/
Disallow /geoip$
Disallow /rest_v1/
Disallow /rest.php/
Disallow /tags/
Disallow /*?action=
Disallow /*?*&action=
Disallow /*?feed=
Disallow /*?*&feed=
Disallow /*?from=
Disallow /*?*&from=
Disallow /*?mobileaction=
Disallow /*?*&mobileaction=
Disallow /*?oldid=
Disallow /*?*&oldid=
Disallow /*?printable=
Disallow /*?*&printable=
Disallow /*?redirect=
Disallow /*?*&redirect=
Disallow /*?uselang=
Disallow /*?*&uselang=
Disallow /*?useskin=
Disallow /*?*&useskin=
Disallow /*?variant=zh-hans
Disallow /*?*&variant=zh-hans
Disallow /*?variant=zh-hant
Disallow /*?*&variant=zh-hant
Disallow /*?veaction=
Disallow /*?*&veaction=
Disallow /*?filefrom=
Disallow /*?*&filefrom=
Disallow /*?fileuntil=
Disallow /*?*&fileuntil=
Disallow /*?navbox=
Disallow /*?*&navbox=
Disallow /*?pageuntil=
Disallow /*?*&pageuntil=
Disallow /*?pagefrom=
Disallow /*?*&pagefrom=
Disallow /*?diff=
Disallow /*?*&diff=
Disallow /*?curid=
Disallow /*?*&curid=
Disallow /*?search=
Disallow /*?*&search=
Disallow /*?section=
Disallow /*?*&section=
Disallow /*?limit=
Disallow /*?*&limit=

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seekport

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

thetradedesk

Rule Path
Disallow /

carbon-umbrella-bot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

terracotta

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

applebot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://oldschool.runescape.wiki/images/sitemaps/index.xml
Back to top

Comments

  • If you are using content from our site, please ensure that you are following the terms of our license (usually a Creative Commons license).
  • For more information, see https://meta.weirdgloop.org/w/Meta:Copyrights
  • SEO bots
  • Huawei's web crawler. Ignores Disallow and gets caught in loops accessing special pages. Produces the majority of uncachable requests.
  • AI bots
Back to top