aussiefarmers.com.au
robots.txt
Robots Exclusion Standard data for aussiefarmers.com.au
Resource Scan
Scan Details
| Site Domain | aussiefarmers.com.au |
| Base Domain | aussiefarmers.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-12T00:24:49+00:00 |
| Next Scan | 2024-12-11T00:24:49+00:00 |
Last Successful Scan
| Scanned | 2024-07-21T17:28:21+00:00 |
| URL | https://www.aussiefarmers.com.au/robots.txt |
| Redirect | https://www.yourgrocer.com.au/robots.txt |
| Redirect Domain | www.yourgrocer.com.au |
| Redirect Base | yourgrocer.com.au |
| Domain IPs | 18.155.68.117, 18.155.68.17, 18.155.68.35, 18.155.68.41 |
| Redirect IPs | 23.22.5.68, 3.226.182.14, 52.21.227.162, 54.237.159.171 |
| Response IP | 3.226.182.14 |
| Found | Yes |
| Hash | 109b002fef4a91a9bd6b6b27ce0ad30d5bb95aaee7406d2f01d9aad566c99383 |
| SimHash | 881babbfe570 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /video |
| Disallow | /new_shop_form.html |
| Disallow | /new_form |
| Disallow | /not_in_location_leads/ |
| Disallow | /shop/free-milk |
| Disallow | /shop/checkout |
| Disallow | /shop/cart |
| Disallow | /shop/orders |
| Disallow | /shop/countries |
| Disallow | /shop/line_items |
| Disallow | /shop/password_resets |
| Disallow | /shop/states |
| Disallow | /shop/user_sessions |
| Disallow | /shop/user_registrations |
| Disallow | /shop/users |
| Disallow | /shop/account |
| Disallow | /dashboard |
| Disallow | /guideline |
| Disallow | /shop/api |
| Disallow | /shop/ |
| Disallow | /deliveries/ |
| Disallow | /locations/8889 |
| Disallow | /sources/test-source |
| Disallow | /delivery-runs/test-region |
| Disallow | /delivery-runs/ivanhoe-plaza |
| Disallow | /info/delivery-runs/ivanhoe-plaza |
| Disallow | /info/delivery-runs/test-region |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.yourgrocer.com.au/sitemap.xml.gz |
Comments