travelgo.com
robots.txt
Robots Exclusion Standard data for travelgo.com
Resource Scan
Scan Details
Site Domain | travelgo.com |
Base Domain | travelgo.com |
Scan Status | Ok |
Last Scan | 2024-11-10T18:35:43+00:00 |
Next Scan | 2024-12-10T18:35:43+00:00 |
Last Scan
Scanned | 2024-11-10T18:35:43+00:00 |
URL | https://www.travelgo.com/robots.txt |
Domain IPs | 23.52.171.152, 23.52.171.160, 2600:1413:b000:13::b857:c190, 2600:1413:b000:13::b857:c19b |
Response IP | 23.45.207.171 |
Found | Yes |
Hash | e34105dc822c929c9bfdc5e3b06a62b575ffe38c5563f8c0d688ac6fc9b067e3 |
SimHash | 0c04c8601343 |
Groups
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /tapi/* |
Disallow | /*/hotel/hotelMonitorLog |
Disallow | /*/hotel/book* |
baiduspider
Rule | Path |
---|---|
Allow | / |
Disallow | /tapi/* |
Disallow | /*/hotel/hotelMonitorLog |
Disallow | /*/hotel/book* |
*
Rule | Path |
---|---|
Allow | /iflight/book1.html* |
Disallow | / |
Allow | /*hotel/* |
Disallow | /tapi/* |
Disallow | /*/hotel/hotelMonitorLog |
Disallow | /*/hotel/book* |
Warnings
- `sitemap https` is not a known field.