bigfoodie.co.uk
robots.txt
Robots Exclusion Standard data for bigfoodie.co.uk
Resource Scan
Scan Details
| Site Domain | bigfoodie.co.uk |
| Base Domain | bigfoodie.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-05-17T16:41:53+00:00 |
| Next Scan | 2024-06-16T16:41:53+00:00 |
Last Scan
| Scanned | 2024-05-17T16:41:53+00:00 |
| URL | https://bigfoodie.co.uk/robots.txt |
| Domain IPs | 2600:9000:2003:1600:a:d0:7000:93a1, 2600:9000:2003:3800:a:d0:7000:93a1, 2600:9000:2003:4a00:a:d0:7000:93a1, 2600:9000:2003:600:a:d0:7000:93a1, 2600:9000:2003:6e00:a:d0:7000:93a1, 2600:9000:2003:9400:a:d0:7000:93a1, 2600:9000:2003:b400:a:d0:7000:93a1, 2600:9000:2003:c000:a:d0:7000:93a1, 52.84.229.16, 52.84.229.54, 52.84.229.64, 52.84.229.91 |
| Response IP | 52.84.229.64 |
| Found | Yes |
| Hash | 1a3a91237ee843eabce449babd584c41378b7cec28e034e665f1088b71c18041 |
| SimHash | e01c9a728b10 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /selby-/the-pizza-grill/info |
| Disallow | /*profile |
| Disallow | /*account |
| Disallow | /*list |
| Disallow | /*%5B |
| Disallow | /*%5D |
| Disallow | /*undefined |
| Disallow | /*null |
| Disallow | /area/ |
| Disallow | /ordernow/ |
| Disallow | /ordernow/* |
| Disallow | /takeaway/ |
| Disallow | /ordernow/*/*/* |
| Disallow | /review/ |
| Disallow | /*?*undefined |
| Disallow | /*.php |
| Disallow | /*.aspx |
| Disallow | /*1000$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bigfoodie.co.uk/sitemap.xml |