foodworks.com.au
robots.txt
Robots Exclusion Standard data for foodworks.com.au
Resource Scan
Scan Details
| Site Domain | foodworks.com.au |
| Base Domain | foodworks.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-02-14T08:50:16+00:00 |
| Next Scan | 2025-04-15T08:50:16+00:00 |
Last Successful Scan
| Scanned | 2024-05-28T07:39:26+00:00 |
| URL | https://foodworks.com.au/robots.txt |
| Redirect | https://www.foodworks.com.au/robots.txt |
| Redirect Domain | www.foodworks.com.au |
| Redirect Base | foodworks.com.au |
| Domain IPs | 116.90.52.19 |
| Redirect IPs | 104.22.36.185, 104.22.37.185, 172.67.37.232, 2606:4700:10::6816:24b9, 2606:4700:10::6816:25b9, 2606:4700:10::ac43:25e8 |
| Response IP | 104.22.37.185 |
| Found | Yes |
| Hash | 16fe3488b9af785ff81e5b9505a3ff943f3a125315cb7f6192bce62c922ab850 |
| SimHash | 12d7100681f0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/views |
| Disallow | /ccm/system/captcha/picture |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 4 invalid lines.