tablebooker.be
robots.txt
Robots Exclusion Standard data for tablebooker.be
Resource Scan
Scan Details
Site Domain | tablebooker.be |
Base Domain | tablebooker.be |
Scan Status | Ok |
Last Scan | 2024-10-22T23:46:03+00:00 |
Next Scan | 2024-11-21T23:46:03+00:00 |
Last Scan
Scanned | 2024-10-22T23:46:03+00:00 |
URL | https://tablebooker.be/robots.txt |
Redirect | https://en.tablebooker.com/robots.txt |
Redirect Domain | en.tablebooker.com |
Redirect Base | tablebooker.com |
Domain IPs | 54.230.112.114, 54.230.112.115, 54.230.112.20, 54.230.112.86 |
Redirect IPs | 54.230.112.114, 54.230.112.115, 54.230.112.20, 54.230.112.86 |
Response IP | 18.165.140.49 |
Found | Yes |
Hash | fe6e14d5e966c9fcabff5d43c57aa59d053cc131ba5e9d9f9f07cab924661382 |
SimHash | b111c0d6aab8 |
Groups
*
Rule | Path |
---|---|
Disallow | /business/search |
Disallow | /business/search/ |
Disallow | /business/feedback |
Disallow | /business/feedback/ |
Disallow | /business/like |
Disallow | /business/like/ |
Disallow | /business/add |
Disallow | /business/add/ |
Disallow | /business/unlike |
Disallow | /business/unlike/ |
Disallow | /restaurant/like |
Disallow | /restaurant/like/ |
Disallow | /restaurant/unlike |
Disallow | /restaurant/unlike/ |
Disallow | /restaurant/preview/cms |
Disallow | /restaurant/preview/cms/ |
Disallow | /logBusinessLinkInterceptor |
Disallow | /logTelephoneInterceptor |
Disallow | /image/upload |
Disallow | /image/upload/ |
Disallow | /image/remove |
Disallow | /image/remove/ |
Disallow | /image/crop |
Disallow | /image/crop/ |
Disallow | /error |
Disallow | /error/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- 2 invalid lines.