Log In Sign Up

yozm.blog
robots.txt

Robots Exclusion Standard data for yozm.blog

Resource Scan

Scan Details

Site Domain yozm.blog
Base Domain yozm.blog
Scan Status Ok
Last Scan2025-11-18T03:00:52+00:00
Next Scan 2025-11-25T03:00:52+00:00

Last Scan

Scanned2025-11-18T03:00:52+00:00
URL https://yozm.blog/robots.txt
Domain IPs 104.21.23.100, 172.67.210.118, 2606:4700:3034::6815:1764, 2606:4700:3034::ac43:d276
Response IP 104.21.23.100
Found Yes
Hash 700836ca274375ab6a11a713d8507af993e3b90aff4ba443d944514f81cdf836
SimHash 469dca01c646

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

slurp

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

google-cloudvertexbot

Rule Path
Allow /

googleother

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity‑user

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

bytespider

Rule Path
Disallow /

youbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

andibot

Rule Path
Disallow /

brightbot 1.0

Rule Path
Disallow /

cotoyogi

Rule Path
Disallow /

crawlspace

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

factset_spyderbot

Rule Path
Disallow /

firecrawlagent

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

iaskspider/2.0

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://yozm.blog/sitemap.xml
Back to top

Comments

  • OpenAI bots
  • Google AI training bots (separate from search)
  • Anthropic (Claude) bots
Back to top