resto.lu
robots.txt

Robots Exclusion Standard data for resto.lu

Resource Scan

Scan Details

Site Domain resto.lu
Base Domain resto.lu
Scan Status Ok
Last Scan2024-09-03T18:56:07+00:00
Next Scan 2024-10-03T18:56:07+00:00

Last Scan

Scanned2024-09-03T18:56:07+00:00
URL https://resto.lu/robots.txt
Redirect https://www.resto.lu/robots.txt
Redirect Domain www.resto.lu
Redirect Base resto.lu
Domain IPs 13.249.9.81
Redirect IPs 2600:9000:24bc:1200:4:21a9:1280:93a1, 2600:9000:24bc:2200:4:21a9:1280:93a1, 2600:9000:24bc:4400:4:21a9:1280:93a1, 2600:9000:24bc:5800:4:21a9:1280:93a1, 2600:9000:24bc:6600:4:21a9:1280:93a1, 2600:9000:24bc:9000:4:21a9:1280:93a1, 2600:9000:24bc:b800:4:21a9:1280:93a1, 2600:9000:24bc:d400:4:21a9:1280:93a1, 3.164.85.28, 3.164.85.31, 3.164.85.86, 3.164.85.98
Response IP 65.9.112.86
Found Yes
Hash d4b752e4797b1f4f5c3b0429595f42e900be54d4b768c074f6b21f8c40f6ded2
SimHash b111c2d6eab8

Groups

*

Rule Path
Disallow /business/search
Disallow /business/search/
Disallow /business/feedback
Disallow /business/feedback/
Disallow /business/like
Disallow /business/like/
Disallow /business/add
Disallow /business/add/
Disallow /business/unlike
Disallow /business/unlike/
Disallow /restaurant/like
Disallow /restaurant/like/
Disallow /restaurant/unlike
Disallow /restaurant/unlike/
Disallow /restaurant/preview/cms
Disallow /restaurant/preview/cms/
Disallow /logBusinessLinkInterceptor
Disallow /logTelephoneInterceptor
Disallow /image/upload
Disallow /image/upload/
Disallow /image/remove
Disallow /image/remove/
Disallow /image/crop
Disallow /image/crop/
Disallow /error
Disallow /error/

Other Records

Field Value
crawl-delay 1

Warnings

  • 2 invalid lines.