experiences.travel.rakuten.com
robots.txt
Robots Exclusion Standard data for experiences.travel.rakuten.com
Resource Scan
Scan Details
| Site Domain | experiences.travel.rakuten.com |
| Base Domain | rakuten.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T00:06:21+00:00 |
| Next Scan | 2024-06-02T00:06:21+00:00 |
Last Scan
| Scanned | 2024-05-03T00:06:21+00:00 |
| URL | https://experiences.travel.rakuten.com/robots.txt |
| Domain IPs | 34.120.81.214 |
| Response IP | 34.120.81.214 |
| Found | Yes |
| Hash | 9e7b8157176d516817e53b6de02a590986998da734bc33fa6c2d26c4142f6b36 |
| SimHash | e111e862cb17 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /contents/ |
| Disallow | /checkout/ |
| Disallow | /my-account/ |
| Disallow | /orders/ |
| Disallow | /experiences/*?scid=we_txp_google-ttd |
Other Records
| Field | Value |
|---|---|
| sitemap | https://experiences.travel.rakuten.com/sitemap_dynamic_index.xml |