Log In Sign Up

bachashuku.org
robots.txt

Robots Exclusion Standard data for bachashuku.org

Resource Scan

Scan Details

Site Domain bachashuku.org
Base Domain bachashuku.org
Scan Status Ok
Last Scan2025-08-18T00:20:03+00:00
Next Scan 2025-09-17T00:20:03+00:00

Last Scan

Scanned2025-08-18T00:20:03+00:00
URL https://bachashuku.org/robots.txt
Domain IPs 104.21.70.5, 172.67.217.68, 2606:4700:3036::6815:4605, 2606:4700:3036::ac43:d944
Response IP 104.21.70.5
Found Yes
Hash 94087da3ed57eb513a92bf4b4755a3bee7cc64781b0617545eccbdc1303c1bfe
SimHash 3c11755263e0

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

googlebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yisouspider

Rule Path
Allow /

haosouspider

Rule Path
Allow /

bingbot

Rule Path
Allow /

sosospider

Rule Path
Allow /

sogouwebspider

Rule Path
Allow /

bytespider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

twiceler

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /admin/*
Disallow /api/*
Disallow /blocks/*
Disallow /cache/*
Disallow /class/*
Disallow /configs/*
Disallow /css/*
Disallow /scripts/*
Disallow /m/*
Disallow /themes/*
Back to top

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
Back to top

Warnings

  • 2 invalid lines.
Back to top