sec.tobutoptours.co.jp
robots.txt

Robots Exclusion Standard data for sec.tobutoptours.co.jp

Resource Scan

Scan Details

Site Domain sec.tobutoptours.co.jp
Base Domain tobutoptours.co.jp
Scan Status Ok
Last Scan2025-10-30T10:20:14+00:00
Next Scan 2025-11-29T10:20:14+00:00

Last Scan

Scanned2025-10-30T10:20:14+00:00
URL https://sec.tobutoptours.co.jp/robots.txt
Domain IPs 74.176.138.165
Response IP 74.176.138.165
Found Yes
Hash 58fc0249c0c98c65d44e37572cd1365f0dcf8a2e00c221e4acf55ee82dbe41e1
SimHash 5c105100c156

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

bard

Rule Path
Disallow /

gemini

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

yandex

Rule Path
Disallow

Comments

  • 既知のAIクローラー個別指定
  • 主要な検索エンジンは明示的に許可