aavegotchi.com
robots.txt

Robots Exclusion Standard data for aavegotchi.com

Resource Scan

Scan Details

Site Domain aavegotchi.com
Base Domain aavegotchi.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-03T09:46:40+00:00
Next Scan 2025-12-10T09:46:40+00:00

Last Successful Scan

Scanned2025-11-02T09:45:56+00:00
URL https://aavegotchi.com/robots.txt
Redirect https://www.aavegotchi.com/robots.txt
Redirect Domain www.aavegotchi.com
Redirect Base aavegotchi.com
Domain IPs 172.66.40.148, 172.66.43.108, 2606:4700:3108::ac42:2894, 2606:4700:3108::ac42:2b6c
Redirect IPs 172.66.40.148, 172.66.43.108, 2606:4700:3108::ac42:2894, 2606:4700:3108::ac42:2b6c
Response IP 172.66.43.108
Found Yes
Hash 328d1eea42eb33feda1653bacd404203396823f4bcab639e5dafbbf741bf63ca
SimHash 4d5579542157

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/

googlebot

Rule Path Comment
Allow / Explicitly allow all for Googlebot
Disallow /api/ -
Disallow /admin/ -

Other Records

Field Value
sitemap https://www.aavegotchi.com/sitemap.xml

Comments

  • Allow crawling for main domain (aavegotchi.com)
  • Disallow specific paths for all crawlers
  • Specific rules for Googlebot (optional, inherits from * if not specified)
  • Disallow specific paths for Googlebot
  • Sitemap location for main domain