booked.net
robots.txt
Robots Exclusion Standard data for booked.net
Resource Scan
Scan Details
Site Domain | booked.net |
Base Domain | booked.net |
Scan Status | Ok |
Last Scan | 2024-05-27T08:18:00+00:00 |
Next Scan | 2024-06-26T08:18:00+00:00 |
Last Scan
Scanned | 2024-05-27T08:18:00+00:00 |
URL | https://booked.net/robots.txt |
Redirect | https://www.booked.net/robots.txt |
Redirect Domain | www.booked.net |
Redirect Base | booked.net |
Domain IPs | 172.66.41.27, 172.66.42.229 |
Redirect IPs | 172.66.41.27, 172.66.42.229 |
Response IP | 172.66.42.229 |
Found | Yes |
Hash | 456ff6ff7d2955c5fb27ce7dd62aa04a7eeb4de71fa5f4aedb009b8f581c7d90 |
SimHash | 28549874cf93 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /reviewpage/ |
Disallow | /ajax/ |
Disallow | /?page=stat |
Disallow | /?page=hotel_ajax |
Disallow | /?page=hotellist_json |
Disallow | /reviewpage2/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.booked.net/data/sitemaps/index.xml |