food-hub.ie
robots.txt
Robots Exclusion Standard data for food-hub.ie
Resource Scan
Scan Details
Site Domain | food-hub.ie |
Base Domain | food-hub.ie |
Scan Status | Ok |
Last Scan | 2024-11-08T07:34:59+00:00 |
Next Scan | 2024-11-22T07:34:59+00:00 |
Last Scan
Scanned | 2024-11-08T07:34:59+00:00 |
URL | https://food-hub.ie/robots.txt |
Domain IPs | 13.33.88.123, 13.33.88.14, 13.33.88.67, 13.33.88.81, 2600:9000:223b:2e00:6:59fa:a40:93a1, 2600:9000:223b:5800:6:59fa:a40:93a1, 2600:9000:223b:7200:6:59fa:a40:93a1, 2600:9000:223b:7800:6:59fa:a40:93a1, 2600:9000:223b:7e00:6:59fa:a40:93a1, 2600:9000:223b:8800:6:59fa:a40:93a1, 2600:9000:223b:8c00:6:59fa:a40:93a1, 2600:9000:223b:cc00:6:59fa:a40:93a1 |
Response IP | 13.33.88.123 |
Found | Yes |
Hash | e9ba3206b0344a5903d227348f4d401fbbbc110695b7b0127228f9e94241db48 |
SimHash | 571c9a72cdd2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /selby-/the-pizza-grill/info |
Disallow | /profile |
Disallow | /account |
Disallow | /basket |
Disallow | /checkout |
Disallow | /orderHistory |
Disallow | /list/* |
Disallow | /*%5B |
Disallow | /*%5D |
Disallow | /*undefined |
Disallow | /*null |
Disallow | /area/ |
Disallow | /ordernow/ |
Disallow | /ordernow/* |
Disallow | /takeaway/ |
Disallow | /ordernow/*/*/* |
Disallow | /review/ |
Disallow | /*.php |
Disallow | /*.aspx |
Disallow | /*1000$ |
Other Records
Field | Value |
---|---|
sitemap | https://food-hub.ie/sitemap.xml |