en.resto.lu
robots.txt
Robots Exclusion Standard data for en.resto.lu
Resource Scan
Scan Details
| Site Domain | en.resto.lu |
| Base Domain | resto.lu |
| Scan Status | Ok |
| Last Scan | 2024-06-07T17:46:34+00:00 |
| Next Scan | 2024-07-07T17:46:34+00:00 |
Last Scan
| Scanned | 2024-06-07T17:46:34+00:00 |
| URL | https://en.resto.lu/robots.txt |
| Domain IPs | 18.65.3.124, 18.65.3.24, 18.65.3.89, 18.65.3.97, 2600:9000:24bc:2600:4:21a9:1280:93a1, 2600:9000:24bc:6400:4:21a9:1280:93a1, 2600:9000:24bc:7600:4:21a9:1280:93a1, 2600:9000:24bc:7e00:4:21a9:1280:93a1, 2600:9000:24bc:9800:4:21a9:1280:93a1, 2600:9000:24bc:ac00:4:21a9:1280:93a1, 2600:9000:24bc:d600:4:21a9:1280:93a1, 2600:9000:24bc:e400:4:21a9:1280:93a1 |
| Response IP | 18.165.171.84 |
| Found | Yes |
| Hash | 74575a78bed9ee25acce57a093c239ed8ef55f0b48a104274066061a4c3b7eb8 |
| SimHash | b319c2d6a8b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /business/search |
| Disallow | /business/search/ |
| Disallow | /business/feedback |
| Disallow | /business/feedback/ |
| Disallow | /business/like |
| Disallow | /business/like/ |
| Disallow | /business/add |
| Disallow | /business/add/ |
| Disallow | /business/unlike |
| Disallow | /business/unlike/ |
| Disallow | /restaurant/like |
| Disallow | /restaurant/like/ |
| Disallow | /restaurant/unlike |
| Disallow | /restaurant/unlike/ |
| Disallow | /restaurant/preview/cms |
| Disallow | /restaurant/preview/cms/ |
| Disallow | /logBusinessLinkInterceptor |
| Disallow | /logTelephoneInterceptor |
| Disallow | /image/upload |
| Disallow | /image/upload/ |
| Disallow | /image/remove |
| Disallow | /image/remove/ |
| Disallow | /image/crop |
| Disallow | /image/crop/ |
| Disallow | /error |
| Disallow | /error/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 2 invalid lines.