tilewarehouse.co.nz
robots.txt
Robots Exclusion Standard data for tilewarehouse.co.nz
Resource Scan
Scan Details
Site Domain | tilewarehouse.co.nz |
Base Domain | tilewarehouse.co.nz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-02-22T22:42:44+00:00 |
Next Scan | 2025-05-23T22:42:44+00:00 |
Last Successful Scan
Scanned | 2024-10-03T08:47:07+00:00 |
URL | https://tilewarehouse.co.nz/robots.txt |
Redirect | https://www.tilewarehouse.co.nz/robots.txt |
Redirect Domain | www.tilewarehouse.co.nz |
Redirect Base | tilewarehouse.co.nz |
Domain IPs | 104.26.10.242, 104.26.11.242, 172.67.70.54, 2606:4700:20::681a:af2, 2606:4700:20::681a:bf2, 2606:4700:20::ac43:4636 |
Redirect IPs | 104.26.10.242, 104.26.11.242, 172.67.70.54, 2606:4700:20::681a:af2, 2606:4700:20::681a:bf2, 2606:4700:20::ac43:4636 |
Response IP | 104.26.10.242 |
Found | Yes |
Hash | 020c376b525db4f35a441d5a47fc0bee12cfa5b78581cd7a1f3bcf042dd596d1 |
SimHash | 6c005c22c082 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /Security/login |
Other Records
Field | Value |
---|---|
sitemap | https://tilewarehouse.co.nz/sitemap.xml |
sitemap | https://architecturalsurfaces.tilewarehouse.co.nz/sitemap.xml |