hu.stardewvalleywiki.com
robots.txt

Robots Exclusion Standard data for hu.stardewvalleywiki.com

Resource Scan

Scan Details

Site Domain hu.stardewvalleywiki.com
Base Domain stardewvalleywiki.com
Scan Status Ok
Last Scan2025-08-19T22:21:05+00:00
Next Scan 2025-09-18T22:21:05+00:00

Last Scan

Scanned2025-08-19T22:21:05+00:00
URL https://hu.stardewvalleywiki.com/robots.txt
Domain IPs 104.26.8.9, 104.26.9.9, 172.67.68.58, 2606:4700:20::681a:809, 2606:4700:20::681a:909, 2606:4700:20::ac43:443a
Response IP 104.26.8.9
Found Yes
Hash 348c3bba719eba2a7c1ae276de4b973b1dfed8273e82c28a11d98d9c4b3d0d1d
SimHash 590c8343e910

Groups

mj12bot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

semrushbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

amazonbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

googleother

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

oai-searchbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /Help%3A
Disallow /Help_talk%3A
Disallow /MediaWiki%3A
Disallow /*title%3DSpecial%3ACreateAccount

Comments

  • Disallow: /mediawiki/
  • Allow: /mediawiki/load.php