en.resto.be
robots.txt
Robots Exclusion Standard data for en.resto.be
Resource Scan
Scan Details
| Site Domain | en.resto.be |
| Base Domain | resto.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-29T21:44:28+00:00 |
| Next Scan | 2024-06-28T21:44:28+00:00 |
Last Successful Scan
| Scanned | 2024-02-07T21:37:12+00:00 |
| URL | https://en.resto.be/robots.txt |
| Domain IPs | 2600:9000:2175:3e00:0:b906:9b00:93a1, 2600:9000:2175:400:0:b906:9b00:93a1, 2600:9000:2175:4400:0:b906:9b00:93a1, 2600:9000:2175:6400:0:b906:9b00:93a1, 2600:9000:2175:8200:0:b906:9b00:93a1, 2600:9000:2175:8c00:0:b906:9b00:93a1, 2600:9000:2175::b906:9b00:93a1, 2600:9000:2175:e200:0:b906:9b00:93a1, 52.84.45.25, 52.84.45.4, 52.84.45.51, 52.84.45.97 |
| Response IP | 13.32.145.124 |
| Found | Yes |
| Hash | 4bc007796530c71ade193f4979496aded6c7027391c433a95a3374c473079c69 |
| SimHash | b111c2d6aab0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /business/search |
| Disallow | /business/search/ |
| Disallow | /business/feedback |
| Disallow | /business/feedback/ |
| Disallow | /business/like |
| Disallow | /business/like/ |
| Disallow | /business/add |
| Disallow | /business/add/ |
| Disallow | /business/unlike |
| Disallow | /business/unlike/ |
| Disallow | /restaurant/like |
| Disallow | /restaurant/like/ |
| Disallow | /restaurant/unlike |
| Disallow | /restaurant/unlike/ |
| Disallow | /restaurant/preview/cms |
| Disallow | /restaurant/preview/cms/ |
| Disallow | /logBusinessLinkInterceptor |
| Disallow | /logTelephoneInterceptor |
| Disallow | /image/upload |
| Disallow | /image/upload/ |
| Disallow | /image/remove |
| Disallow | /image/remove/ |
| Disallow | /image/crop |
| Disallow | /image/crop/ |
| Disallow | /error |
| Disallow | /error/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 2 invalid lines.