travelex.co.jp
robots.txt
Robots Exclusion Standard data for travelex.co.jp
Resource Scan
Scan Details
Site Domain | travelex.co.jp |
Base Domain | travelex.co.jp |
Scan Status | Ok |
Last Scan | 2024-06-19T10:16:59+00:00 |
Next Scan | 2024-07-19T10:16:59+00:00 |
Last Scan
Scanned | 2024-06-19T10:16:59+00:00 |
URL | https://travelex.co.jp/robots.txt |
Redirect | https://www.travelex.co.jp/robots.txt |
Redirect Domain | www.travelex.co.jp |
Redirect Base | travelex.co.jp |
Domain IPs | 35.71.159.117, 52.223.24.35 |
Redirect IPs | 108.156.133.102, 108.156.133.124, 108.156.133.3, 108.156.133.42, 2600:9000:2755:a400:0:6870:3380:93a1, 2600:9000:2755:c400:0:6870:3380:93a1, 2600:9000:2755:c600:0:6870:3380:93a1, 2600:9000:2755:d800:0:6870:3380:93a1, 2600:9000:2755:f000:0:6870:3380:93a1, 2600:9000:2755:f600:0:6870:3380:93a1, 2600:9000:2755:fa00:0:6870:3380:93a1, 2600:9000:2755:fc00:0:6870:3380:93a1 |
Response IP | 108.156.133.102 |
Found | Yes |
Hash | 55c763d80d9b0f28596fc6825467df8707fdafab50fea56b6f65766d785de406 |
SimHash | 4b0849646e51 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /App_Data/ |
Disallow | /masterpages/ |
Disallow | /bin/ |
Disallow | /config/ |
Disallow | /data/ |
Disallow | /includes/ |
Disallow | /Properties/ |
Disallow | /umbraco/ |
Disallow | /umbraco_client/ |
Disallow | /usercontrols/ |
Disallow | /usync/ |
Disallow | /Views/ |
Disallow | /Web.config |
Other Records
Field | Value |
---|---|
sitemap | https://www.travelex.co.jp/xml-site-map |