Log In Sign Up

youbmt9.blogspot.com
robots.txt

Robots Exclusion Standard data for youbmt9.blogspot.com

Resource Scan

Scan Details

Site Domain youbmt9.blogspot.com
Base Domain youbmt9.blogspot.com
Scan Status Ok
Last Scan2026-03-31T21:53:51+00:00
Next Scan 2026-04-07T21:53:51+00:00

Last Scan

Scanned2026-03-31T21:53:51+00:00
URL https://youbmt9.blogspot.com/robots.txt
Domain IPs 2404:6800:4003:c00::84, 74.125.24.132
Response IP 142.251.10.132
Found Yes
Hash f0faba4c232747855182d18faa0649dea12b0c15741319ee2a7da527e6ff0dff
SimHash 60b11841f6f4

Groups

*

Rule Path
Disallow /search
Disallow /p/
Disallow /comments/
Disallow /feeds/
Disallow /draft/
Disallow /edit/
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://youbmt9.blogspot.com/sitemap.xml
Back to top

Comments

  • Allow important crawling
  • Googlebot specific
  • Bingbot (important for AI like Copilot)
  • OpenAI bot (ChatGPT)
  • Google AI (Gemini uses Googlebot)
  • Block aggressive SEO bots (optional)
  • Sitemap (optimized)
Back to top