bigface.co.nz
robots.txt
Robots Exclusion Standard data for bigface.co.nz
Resource Scan
Scan Details
| Site Domain | bigface.co.nz |
| Base Domain | bigface.co.nz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-17T13:59:14+00:00 |
| Next Scan | 2025-11-16T13:59:14+00:00 |
Last Successful Scan
| Scanned | 2025-06-26T15:42:26+00:00 |
| URL | https://bigface.co.nz/robots.txt |
| Redirect | https://www.bigface.co.nz/robots.txt |
| Redirect Domain | www.bigface.co.nz |
| Redirect Base | bigface.co.nz |
| Domain IPs | 104.21.25.156, 172.67.134.90, 2606:4700:3030::6815:199c, 2606:4700:3036::ac43:865a |
| Redirect IPs | 104.21.25.156, 172.67.134.90, 2606:4700:3030::6815:199c, 2606:4700:3036::ac43:865a |
| Response IP | 104.21.25.156 |
| Found | Yes |
| Hash | b8c1d267f5ab5290a26a52e01fd001b5b9fdc3b3498f75a4c03760326eff1033 |
| SimHash | 6d50d99577c1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin%2C/images%2C/js%2C/style |
| Disallow | /*.gif$ |
| Disallow | /*.Gif$ |
| Disallow | /*.GIF$ |
| Disallow | /*.jpg$ |
| Disallow | /*.Jpg$ |
| Disallow | /*.JPG$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.Jpeg$ |
| Disallow | /*.JPEG$ |
| Disallow | /*.pdf$ |
| Disallow | /*.Pdf$ |
| Disallow | /*.PDF$ |
| Disallow | /*.zip$ |
| Disallow | /*.Zip$ |
| Disallow | /*.ZIP$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |