Log In Sign Up

travelbook.co.jp
robots.txt

Robots Exclusion Standard data for travelbook.co.jp

Resource Scan

Scan Details

Site Domain travelbook.co.jp
Base Domain travelbook.co.jp
Scan Status Ok
Last Scan2024-11-02T18:54:49+00:00
Next Scan 2024-11-09T18:54:49+00:00

Last Scan

Scanned2024-11-02T18:54:49+00:00
URL https://www.travelbook.co.jp/robots.txt
Domain IPs 104.22.0.59, 104.22.1.59, 172.67.29.254, 2606:4700:10::6816:13b, 2606:4700:10::6816:3b, 2606:4700:10::ac43:1dfe
Response IP 172.67.29.254
Found Yes
Hash 4ab8b6bfc27df19cf4dd74ea7984cc9ce8647b58738c4e7f8e8dd4b71ae1dc92
SimHash 68acf861e5b3

Groups

*

Rule Path
Disallow /b64r/
Disallow /search/
Disallow /ad/
Disallow /r/
Disallow /c/
Disallow /*?p=
Disallow /*?*&p=

bingbot

Rule Path
Disallow /b64r/
Disallow /search/
Disallow /ad/
Disallow /r/
Disallow /c/

Other Records

Field Value
crawl-delay 1

applebot

Rule Path
Disallow /tour-domestic/

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.travelbook.co.jp/sitemap/sitemap_all.xml
Back to top