wiki.warframe.com
robots.txt

Robots Exclusion Standard data for wiki.warframe.com

Resource Scan

Scan Details

Site Domain wiki.warframe.com
Base Domain warframe.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-11T00:19:33+00:00
Next Scan 2025-07-10T00:19:33+00:00

Last Successful Scan

Scanned2025-02-17T23:48:31+00:00
URL https://wiki.warframe.com/robots.txt
Domain IPs 104.26.4.101, 104.26.5.101, 172.67.71.107, 2606:4700:20::681a:465, 2606:4700:20::681a:565, 2606:4700:20::ac43:476b
Response IP 104.26.5.101
Found Yes
Hash 912939c143ef3c122d9a447fe2b485b8ad6cf6feb014cfb94299951341717156
SimHash 30de2952ccef

Groups

*

Rule Path
Disallow /w/Property%3A
Disallow /w/Property%3A
Disallow /w/property%3A
Disallow /*?title=Property%3A
Disallow /*?title=Property%3A
Disallow /*?*&title=Property%3A
Disallow /*?*&title=Property%3A
Disallow /w/Special%3A
Disallow /w/Special%3A
Disallow /w/special%3A
Disallow /*?title=Special%3A
Disallow /*?title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /*?*&title=Special%3A
Disallow /api.php
Disallow /cors/
Disallow /geoip$
Disallow /rest_v1/
Disallow /tags/
Disallow /*?action=
Disallow /*?*&action=
Disallow /*?feed=
Disallow /*?*&feed=
Disallow /*?from=
Disallow /*?*&from=
Disallow /*?mobileaction=
Disallow /*?*&mobileaction=
Disallow /*?oldid=
Disallow /*?*&oldid=
Disallow /*?printable=
Disallow /*?*&printable=
Disallow /*?redirect=
Disallow /*?*&redirect=
Disallow /*?uselang=
Disallow /*?*&uselang=
Disallow /*?useskin=
Disallow /*?*&useskin=
Disallow /*?variant=zh-hans
Disallow /*?*&variant=zh-hans
Disallow /*?variant=zh-hant
Disallow /*?*&variant=zh-hant
Disallow /*?veaction=
Disallow /*?*&veaction=
Disallow /*?filefrom=
Disallow /*?*&filefrom=
Disallow /*?fileuntil=
Disallow /*?*&fileuntil=
Disallow /*?navbox=
Disallow /*?*&navbox=
Disallow /*?pageuntil=
Disallow /*?*&pageuntil=
Disallow /*?pagefrom=
Disallow /*?*&pagefrom=
Disallow /*?diff=
Disallow /*?*&diff=
Disallow /*?curid=
Disallow /*?*&curid=
Disallow /*?search=
Disallow /*?*&search=
Disallow /*?section=
Disallow /*?*&section=

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seekport

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

thetradedesk

Rule Path
Disallow /

carbon-umbrella-bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://wiki.warframe.com/images/sitemaps/index.xml

Comments

  • If you are using content from our site, please ensure that you are following the terms of our license (usually a Creative Commons license).
  • For more information, see https://meta.weirdgloop.org/w/Meta:Copyrights
  • SEO bots
  • Huawei's web crawler. Ignores Disallow and gets caught in loops accessing special pages. Produces the majority of uncachable requests.
  • AI bots