mytrip.net
robots.txt
Robots Exclusion Standard data for mytrip.net
Resource Scan
Scan Details
Site Domain | mytrip.net |
Base Domain | mytrip.net |
Scan Status | Ok |
Last Scan | 2024-06-21T11:17:25+00:00 |
Next Scan | 2024-06-28T11:17:25+00:00 |
Last Scan
Scanned | 2024-06-21T11:17:25+00:00 |
URL | https://www.mytrip.net/robots.txt |
Redirect | https://travel.rakuten.co.jp/robots.txt |
Redirect Domain | travel.rakuten.co.jp |
Redirect Base | rakuten.co.jp |
Domain IPs | 133.237.49.225 |
Redirect IPs | 184.27.122.186, 184.27.122.202 |
Response IP | 42.99.140.211 |
Found | Yes |
Hash | 1fa170445a673e3f05c8660c03121646687f0f976a8961631ccfe95043a01be4 |
SimHash | 2854516483d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /B2B/ |
Disallow | /*_trvmkt* |
Disallow | /bus/d_route_list/d_*_* |
Disallow | /bus/a_route_list/a_*_* |
Disallow | /bus/bus_list/d_*_a_*_* |
Disallow | /bus/bus_list/d_*_*_a_* |
Disallow | /bus/bus_list/d_*_*_a_*_* |
Disallow | /package/jr/reserveStep/* |