resto.lu
robots.txt
Robots Exclusion Standard data for resto.lu
Resource Scan
Scan Details
Site Domain | resto.lu |
Base Domain | resto.lu |
Scan Status | Ok |
Last Scan | 2024-09-03T18:56:07+00:00 |
Next Scan | 2024-10-03T18:56:07+00:00 |
Last Scan
Scanned | 2024-09-03T18:56:07+00:00 |
URL | https://resto.lu/robots.txt |
Redirect | https://www.resto.lu/robots.txt |
Redirect Domain | www.resto.lu |
Redirect Base | resto.lu |
Domain IPs | 13.249.9.81 |
Redirect IPs | 2600:9000:24bc:1200:4:21a9:1280:93a1, 2600:9000:24bc:2200:4:21a9:1280:93a1, 2600:9000:24bc:4400:4:21a9:1280:93a1, 2600:9000:24bc:5800:4:21a9:1280:93a1, 2600:9000:24bc:6600:4:21a9:1280:93a1, 2600:9000:24bc:9000:4:21a9:1280:93a1, 2600:9000:24bc:b800:4:21a9:1280:93a1, 2600:9000:24bc:d400:4:21a9:1280:93a1, 3.164.85.28, 3.164.85.31, 3.164.85.86, 3.164.85.98 |
Response IP | 65.9.112.86 |
Found | Yes |
Hash | d4b752e4797b1f4f5c3b0429595f42e900be54d4b768c074f6b21f8c40f6ded2 |
SimHash | b111c2d6eab8 |
Groups
*
Rule | Path |
---|---|
Disallow | /business/search |
Disallow | /business/search/ |
Disallow | /business/feedback |
Disallow | /business/feedback/ |
Disallow | /business/like |
Disallow | /business/like/ |
Disallow | /business/add |
Disallow | /business/add/ |
Disallow | /business/unlike |
Disallow | /business/unlike/ |
Disallow | /restaurant/like |
Disallow | /restaurant/like/ |
Disallow | /restaurant/unlike |
Disallow | /restaurant/unlike/ |
Disallow | /restaurant/preview/cms |
Disallow | /restaurant/preview/cms/ |
Disallow | /logBusinessLinkInterceptor |
Disallow | /logTelephoneInterceptor |
Disallow | /image/upload |
Disallow | /image/upload/ |
Disallow | /image/remove |
Disallow | /image/remove/ |
Disallow | /image/crop |
Disallow | /image/crop/ |
Disallow | /error |
Disallow | /error/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- 2 invalid lines.