foodhub.com.au
robots.txt
Robots Exclusion Standard data for foodhub.com.au
Resource Scan
Scan Details
| Site Domain | foodhub.com.au |
| Base Domain | foodhub.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-06T19:15:24+00:00 |
| Next Scan | 2024-11-20T19:15:24+00:00 |
Last Scan
| Scanned | 2024-11-06T19:15:24+00:00 |
| URL | https://foodhub.com.au/robots.txt |
| Domain IPs | 13.33.88.123, 13.33.88.14, 13.33.88.67, 13.33.88.81, 2600:9000:223b:1a00:6:59fa:a40:93a1, 2600:9000:223b:4200:6:59fa:a40:93a1, 2600:9000:223b:5200:6:59fa:a40:93a1, 2600:9000:223b:6a00:6:59fa:a40:93a1, 2600:9000:223b:b400:6:59fa:a40:93a1, 2600:9000:223b:ba00:6:59fa:a40:93a1, 2600:9000:223b:cc00:6:59fa:a40:93a1, 2600:9000:223b:d800:6:59fa:a40:93a1 |
| Response IP | 13.33.88.67 |
| Found | Yes |
| Hash | 32d8cafec6a5b0e4dd144fe31584958a646943b1907db6d1d9ed14c2d6e7d14e |
| SimHash | 17149a72cd90 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /selby-/the-pizza-grill/info |
| Disallow | /profile |
| Disallow | /account |
| Disallow | /basket |
| Disallow | /checkout |
| Disallow | /orderHistory |
| Disallow | /list/* |
| Disallow | /*%5B |
| Disallow | /*%5D |
| Disallow | /*undefined |
| Disallow | /*null |
| Disallow | /area/ |
| Disallow | /ordernow/ |
| Disallow | /ordernow/* |
| Disallow | /takeaway/ |
| Disallow | /ordernow/*/*/* |
| Disallow | /review/ |
| Disallow | /*.php |
| Disallow | /*.aspx |
| Disallow | /*1000$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://foodhub.com.au/sitemap.xml |