travel.rakuten.co.jp
robots.txt
Robots Exclusion Standard data for travel.rakuten.co.jp
Resource Scan
Scan Details
| Site Domain | travel.rakuten.co.jp |
| Base Domain | rakuten.co.jp |
| Scan Status | Ok |
| Last Scan | 2024-05-14T22:28:32+00:00 |
| Next Scan | 2024-05-21T22:28:32+00:00 |
Last Scan
| Scanned | 2024-05-14T22:28:32+00:00 |
| URL | https://travel.rakuten.co.jp/robots.txt |
| Domain IPs | 96.17.72.41, 96.17.72.56 |
| Response IP | 42.99.140.211 |
| Found | Yes |
| Hash | 1fa170445a673e3f05c8660c03121646687f0f976a8961631ccfe95043a01be4 |
| SimHash | 2854516483d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /B2B/ |
| Disallow | /*_trvmkt* |
| Disallow | /bus/d_route_list/d_*_* |
| Disallow | /bus/a_route_list/a_*_* |
| Disallow | /bus/bus_list/d_*_a_*_* |
| Disallow | /bus/bus_list/d_*_*_a_* |
| Disallow | /bus/bus_list/d_*_*_a_*_* |
| Disallow | /package/jr/reserveStep/* |