food-hub.ie
robots.txt
Robots Exclusion Standard data for food-hub.ie
Resource Scan
Scan Details
Site Domain | food-hub.ie |
Base Domain | food-hub.ie |
Scan Status | Ok |
Last Scan | 2024-09-13T07:30:28+00:00 |
Next Scan | 2024-09-27T07:30:28+00:00 |
Last Scan
Scanned | 2024-09-13T07:30:28+00:00 |
URL | https://food-hub.ie/robots.txt |
Domain IPs | 13.33.88.123, 13.33.88.14, 13.33.88.67, 13.33.88.81, 2600:9000:223b:2e00:6:59fa:a40:93a1, 2600:9000:223b:4a00:6:59fa:a40:93a1, 2600:9000:223b:7e00:6:59fa:a40:93a1, 2600:9000:223b:9000:6:59fa:a40:93a1, 2600:9000:223b:9c00:6:59fa:a40:93a1, 2600:9000:223b:aa00:6:59fa:a40:93a1, 2600:9000:223b:b400:6:59fa:a40:93a1, 2600:9000:223b:d400:6:59fa:a40:93a1 |
Response IP | 13.33.88.67 |
Found | Yes |
Hash | e9ba3206b0344a5903d227348f4d401fbbbc110695b7b0127228f9e94241db48 |
SimHash | 571c9a72cdd2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /selby-/the-pizza-grill/info |
Disallow | /profile |
Disallow | /account |
Disallow | /basket |
Disallow | /checkout |
Disallow | /orderHistory |
Disallow | /list/* |
Disallow | /*%5B |
Disallow | /*%5D |
Disallow | /*undefined |
Disallow | /*null |
Disallow | /area/ |
Disallow | /ordernow/ |
Disallow | /ordernow/* |
Disallow | /takeaway/ |
Disallow | /ordernow/*/*/* |
Disallow | /review/ |
Disallow | /*.php |
Disallow | /*.aspx |
Disallow | /*1000$ |
Other Records
Field | Value |
---|---|
sitemap | https://food-hub.ie/sitemap.xml |