yourgrocer.com.au
robots.txt
Robots Exclusion Standard data for yourgrocer.com.au
Resource Scan
Scan Details
| Site Domain | yourgrocer.com.au |
| Base Domain | yourgrocer.com.au |
| Scan Status | Ok |
| Last Scan | 2024-10-22T23:12:57+00:00 |
| Next Scan | 2024-11-21T23:12:57+00:00 |
Last Scan
| Scanned | 2024-10-22T23:12:57+00:00 |
| URL | https://www.yourgrocer.com.au/robots.txt |
| Domain IPs | 23.22.5.68, 3.226.182.14, 52.21.227.162, 54.237.159.171 |
| Response IP | 23.22.5.68 |
| Found | Yes |
| Hash | 109b002fef4a91a9bd6b6b27ce0ad30d5bb95aaee7406d2f01d9aad566c99383 |
| SimHash | 881babbfe570 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /video |
| Disallow | /new_shop_form.html |
| Disallow | /new_form |
| Disallow | /not_in_location_leads/ |
| Disallow | /shop/free-milk |
| Disallow | /shop/checkout |
| Disallow | /shop/cart |
| Disallow | /shop/orders |
| Disallow | /shop/countries |
| Disallow | /shop/line_items |
| Disallow | /shop/password_resets |
| Disallow | /shop/states |
| Disallow | /shop/user_sessions |
| Disallow | /shop/user_registrations |
| Disallow | /shop/users |
| Disallow | /shop/account |
| Disallow | /dashboard |
| Disallow | /guideline |
| Disallow | /shop/api |
| Disallow | /shop/ |
| Disallow | /deliveries/ |
| Disallow | /locations/8889 |
| Disallow | /sources/test-source |
| Disallow | /delivery-runs/test-region |
| Disallow | /delivery-runs/ivanhoe-plaza |
| Disallow | /info/delivery-runs/ivanhoe-plaza |
| Disallow | /info/delivery-runs/test-region |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.yourgrocer.com.au/sitemap.xml.gz |
Comments