tilewarehouse.co.nz
robots.txt

Robots Exclusion Standard data for tilewarehouse.co.nz

Resource Scan

Scan Details

Site Domain tilewarehouse.co.nz
Base Domain tilewarehouse.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-22T22:42:44+00:00
Next Scan 2025-05-23T22:42:44+00:00

Last Successful Scan

Scanned2024-10-03T08:47:07+00:00
URL https://tilewarehouse.co.nz/robots.txt
Redirect https://www.tilewarehouse.co.nz/robots.txt
Redirect Domain www.tilewarehouse.co.nz
Redirect Base tilewarehouse.co.nz
Domain IPs 104.26.10.242, 104.26.11.242, 172.67.70.54, 2606:4700:20::681a:af2, 2606:4700:20::681a:bf2, 2606:4700:20::ac43:4636
Redirect IPs 104.26.10.242, 104.26.11.242, 172.67.70.54, 2606:4700:20::681a:af2, 2606:4700:20::681a:bf2, 2606:4700:20::ac43:4636
Response IP 104.26.10.242
Found Yes
Hash 020c376b525db4f35a441d5a47fc0bee12cfa5b78581cd7a1f3bcf042dd596d1
SimHash 6c005c22c082

Groups

swiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /admin
Disallow /Security/login

Other Records

Field Value
sitemap https://tilewarehouse.co.nz/sitemap.xml
sitemap https://architecturalsurfaces.tilewarehouse.co.nz/sitemap.xml