japan.travel
robots.txt
Robots Exclusion Standard data for japan.travel
Resource Scan
Scan Details
Site Domain | japan.travel |
Base Domain | japan.travel |
Scan Status | Ok |
Last Scan | 2024-05-11T03:30:13+00:00 |
Next Scan | 2024-06-10T03:30:13+00:00 |
Last Scan
Scanned | 2024-05-11T03:30:13+00:00 |
URL | https://www.japan.travel/robots.txt |
Domain IPs | 18.155.68.102, 18.155.68.38, 18.155.68.65, 18.155.68.72, 2600:9000:23d2:1400:11:d9e2:c140:93a1, 2600:9000:23d2:200:11:d9e2:c140:93a1, 2600:9000:23d2:2600:11:d9e2:c140:93a1, 2600:9000:23d2:5e00:11:d9e2:c140:93a1, 2600:9000:23d2:8c00:11:d9e2:c140:93a1, 2600:9000:23d2:a600:11:d9e2:c140:93a1, 2600:9000:23d2:b000:11:d9e2:c140:93a1, 2600:9000:23d2:d800:11:d9e2:c140:93a1 |
Response IP | 18.155.68.65 |
Found | Yes |
Hash | c39e150fe6ab8143d1a53535200dc7da6ab9f9b2f121bfdd23036f678c30dd08 |
SimHash | c9019876c313 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /*/travel-directory/* |
Disallow | /jp/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.japan.travel/sitemap.xml |