es.stardewvalleywiki.com
robots.txt

Robots Exclusion Standard data for es.stardewvalleywiki.com

Resource Scan

Scan Details

Site Domain es.stardewvalleywiki.com
Base Domain stardewvalleywiki.com
Scan Status Ok
Last Scan2024-10-07T14:13:24+00:00
Next Scan 2024-11-06T14:13:24+00:00

Last Scan

Scanned2024-10-07T14:13:24+00:00
URL https://es.stardewvalleywiki.com/robots.txt
Domain IPs 104.26.8.9, 104.26.9.9, 172.67.68.58, 2606:4700:20::681a:809, 2606:4700:20::681a:909, 2606:4700:20::ac43:443a
Response IP 104.26.8.9
Found Yes
Hash 227e6dcab92740b55c5e07c0a2da5991bb8cd2cca6ee1a4c4cb7c661f1a91169
SimHash 591c8353ef10

Groups

mj12bot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

semrushbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

amazonbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

googleother

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

oai-searchbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

imagesiftbot

Rule Path
Disallow /mediawiki/
Disallow /Special%3A

claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /Help%3A
Disallow /Help_talk%3A
Disallow /MediaWiki%3A

Comments

  • Disallow: /mediawiki/
  • Allow: /mediawiki/load.php