exceed.co.nz
robots.txt

Robots Exclusion Standard data for exceed.co.nz

Resource Scan

Scan Details

Site Domain exceed.co.nz
Base Domain exceed.co.nz
Scan Status Ok
Last Scan2024-10-07T04:49:21+00:00
Next Scan 2024-11-06T04:49:21+00:00

Last Scan

Scanned2024-10-07T04:49:21+00:00
URL https://exceed.co.nz/robots.txt
Redirect https://www.exceed.co.nz/robots.txt
Redirect Domain www.exceed.co.nz
Redirect Base exceed.co.nz
Domain IPs 151.101.2.114
Redirect IPs 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114, 2a04:4e42:200::626, 2a04:4e42:400::626, 2a04:4e42:600::626, 2a04:4e42::626
Response IP 199.232.46.114
Found Yes
Hash 5a81f4cc793435571df4b287e738a01d68c0d75f90c86580c4872281885e110e
SimHash 43301d526533

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.exceed.co.nz/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.exceed.co.nz/
  • live - don't allow web crawlers to index cpresources/ or vendor/