herschelsupplyco.co.nz
robots.txt

Robots Exclusion Standard data for herschelsupplyco.co.nz

Resource Scan

Scan Details

Site Domain herschelsupplyco.co.nz
Base Domain herschelsupplyco.co.nz
Scan Status Ok
Last Scan2024-11-17T18:51:15+00:00
Next Scan 2024-12-17T18:51:15+00:00

Last Scan

Scanned2024-11-17T18:51:15+00:00
URL https://herschelsupplyco.co.nz/robots.txt
Redirect https://www.herschel.nz/robots.txt
Redirect Domain www.herschel.nz
Redirect Base herschel.nz
Domain IPs 13.33.88.115, 13.33.88.117, 13.33.88.32, 13.33.88.47
Redirect IPs 104.18.16.161, 104.18.17.161, 2606:4700::6812:10a1, 2606:4700::6812:11a1
Response IP 104.18.16.161
Found Yes
Hash 995e436d904eec6afcdd335ff67c2c9787dc087f279a6034d00e4c1cfc9c1ca1
SimHash 6d115a6ecc92

Groups

*

Rule Path
Disallow /account
Disallow /cart
Disallow /checkout
Disallow /search

Other Records

Field Value
sitemap https://www.herschel.nz/sitemap.xml