Log In Sign Up

monsterhunterwiki.org
robots.txt

Robots Exclusion Standard data for monsterhunterwiki.org

Resource Scan

Scan Details

Site Domain monsterhunterwiki.org
Base Domain monsterhunterwiki.org
Scan Status Ok
Last Scan2026-01-14T11:22:37+00:00
Next Scan 2026-02-13T11:22:37+00:00

Last Scan

Scanned2026-01-14T11:22:37+00:00
URL https://monsterhunterwiki.org/robots.txt
Domain IPs 104.21.88.20, 172.67.171.248, 2606:4700:3032::6815:5814, 2606:4700:3036::ac43:abf8
Response IP 172.67.171.248
Found Yes
Hash 69bc62354d3da3c3f63fa4eb951b841679a454af4059ec5391caaaa799279854
SimHash 30de2952ccef

Groups

*

Rule Path
Disallow /wiki/Property%3A
Disallow /wiki/Property%3A
Disallow /wiki/property%3A
Disallow /*?title=Property%3A
Disallow /*?title=Property%3A
Disallow /*?*&title=Property%3A
Disallow /*?*&title=Property%3A
Disallow /wiki/Special%3A
Disallow /wiki/Special%3A
Disallow /wiki/special%3A
Disallow /*?title=Special%3A
Disallow /*?title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /api.php
Disallow /cors/
Disallow /geoip$
Disallow /rest_v1/
Disallow /tags/
Disallow /*?action=
Disallow /*?*&action=
Disallow /*?feed=
Disallow /*?*&feed=
Disallow /*?from=
Disallow /*?*&from=
Disallow /*?mobileaction=
Disallow /*?*&mobileaction=
Disallow /*?oldid=
Disallow /*?*&oldid=
Disallow /*?printable=
Disallow /*?*&printable=
Disallow /*?redirect=
Disallow /*?*&redirect=
Disallow /*?uselang=
Disallow /*?*&uselang=
Disallow /*?useskin=
Disallow /*?*&useskin=
Disallow /*?variant=zh-hans
Disallow /*?*&variant=zh-hans
Disallow /*?variant=zh-hant
Disallow /*?*&variant=zh-hant
Disallow /*?veaction=
Disallow /*?*&veaction=
Disallow /*?filefrom=
Disallow /*?*&filefrom=
Disallow /*?fileuntil=
Disallow /*?*&fileuntil=
Disallow /*?navbox=
Disallow /*?*&navbox=
Disallow /*?pageuntil=
Disallow /*?*&pageuntil=
Disallow /*?pagefrom=
Disallow /*?*&pagefrom=
Disallow /*?diff=
Disallow /*?*&diff=
Disallow /*?curid=
Disallow /*?*&curid=
Disallow /*?search=
Disallow /*?*&search=
Disallow /*?section=
Disallow /*?*&section=

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seekport

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://monsterhunterwiki.org/sitemap/sitemap-index-monsterhunterwiki.org.xml
Back to top

Comments

  • If you are using content from our site, please ensure that you are following the terms of our license (usually a Creative Commons license).
  • For more information, see https://meta.weirdgloop.org/wiki/Meta:Copyrights
  • SEO bots
  • Huawei's web crawler. Ignores Disallow and gets caught in loops accessing special pages. Produces the majority of uncachable requests.
  • AI bots
Back to top