ja.japantravel.com
robots.txt

Robots Exclusion Standard data for ja.japantravel.com

Resource Scan

Scan Details

Site Domain ja.japantravel.com
Base Domain japantravel.com
Scan Status Ok
Last Scan2024-11-08T08:59:14+00:00
Next Scan 2024-12-08T08:59:14+00:00

Last Scan

Scanned2024-11-08T08:59:14+00:00
URL https://ja.japantravel.com/robots.txt
Domain IPs 139.162.81.108
Response IP 139.162.81.108
Found Yes
Hash e4347a9b8709ca178c659c5bd2e8e49007fb2d98c818c09e801fc52eb646c32e
SimHash 490458555751

Groups

twitterbot

Rule Path
Allow /permalink/*

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /search*

Other Records

Field Value
sitemap https://ja.japantravel.com/sitemap/ja/sitemap.xml