tospo-keiba.jp
robots.txt

Robots Exclusion Standard data for tospo-keiba.jp

Resource Scan

Scan Details

Site Domain tospo-keiba.jp
Base Domain tospo-keiba.jp
Scan Status Ok
Last Scan2024-11-12T10:41:50+00:00
Next Scan 2024-11-19T10:41:50+00:00

Last Scan

Scanned2024-11-12T10:41:50+00:00
URL https://tospo-keiba.jp/robots.txt
Domain IPs 13.227.254.32, 13.227.254.52, 13.227.254.71, 13.227.254.84
Response IP 13.227.254.84
Found Yes
Hash 5ce4b96d166dee6f32c9e2ff8f2b7c0c7ed9d6ce5331da099d6637273548210d
SimHash 583dd9406113

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /hopefulhorse-2022

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tospo-keiba.jp/sitemap_index.xml