travelgo.com
robots.txt

Robots Exclusion Standard data for travelgo.com

Resource Scan

Scan Details

Site Domain travelgo.com
Base Domain travelgo.com
Scan Status Ok
Last Scan2024-11-10T18:35:43+00:00
Next Scan 2024-12-10T18:35:43+00:00

Last Scan

Scanned2024-11-10T18:35:43+00:00
URL https://www.travelgo.com/robots.txt
Domain IPs 23.52.171.152, 23.52.171.160, 2600:1413:b000:13::b857:c190, 2600:1413:b000:13::b857:c19b
Response IP 23.45.207.171
Found Yes
Hash e34105dc822c929c9bfdc5e3b06a62b575ffe38c5563f8c0d688ac6fc9b067e3
SimHash 0c04c8601343

Groups

googlebot

Rule Path
Allow /
Disallow /tapi/*
Disallow /*/hotel/hotelMonitorLog
Disallow /*/hotel/book*

baiduspider

Rule Path
Allow /
Disallow /tapi/*
Disallow /*/hotel/hotelMonitorLog
Disallow /*/hotel/book*

*

Rule Path
Allow /iflight/book1.html*
Disallow /
Allow /*hotel/*
Disallow /tapi/*
Disallow /*/hotel/hotelMonitorLog
Disallow /*/hotel/book*

Warnings

  • `sitemap https` is not a known field.