cryptospend.com.au
robots.txt

Robots Exclusion Standard data for cryptospend.com.au

Resource Scan

Scan Details

Site Domain cryptospend.com.au
Base Domain cryptospend.com.au
Scan Status Ok
Last Scan2025-12-17T19:53:19+00:00
Next Scan 2025-12-24T19:53:19+00:00

Last Scan

Scanned2025-12-17T19:53:19+00:00
URL https://www.cryptospend.com.au/robots.txt
Redirect https://www.wayex.com/robots.txt
Redirect Domain www.wayex.com
Redirect Base wayex.com
Domain IPs 18.244.51.113, 18.244.51.28, 18.244.51.31, 18.244.51.38
Redirect IPs 18.244.51.3, 18.244.51.48, 18.244.51.51, 18.244.51.82, 2600:9000:2787:1c00:1f:e30f:da40:93a1, 2600:9000:2787:2000:1f:e30f:da40:93a1, 2600:9000:2787:2a00:1f:e30f:da40:93a1, 2600:9000:2787:3200:1f:e30f:da40:93a1, 2600:9000:2787:800:1f:e30f:da40:93a1, 2600:9000:2787:a800:1f:e30f:da40:93a1, 2600:9000:2787:d600:1f:e30f:da40:93a1, 2600:9000:2787:fa00:1f:e30f:da40:93a1
Response IP 65.8.76.60
Found Yes
Hash f3f35cfd1d78d1e8020166ea61a8fe55f3576a18d895bc6ae3938bc2aae34e4e
SimHash 49014c12e507

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/

Other Records

Field Value
sitemap https://wayex.com/sitemap-index.xml

Comments

  • Main sitemap index (references all locale-specific sitemaps)
  • Block crawling of API routes and admin paths