hcbb.info
robots.txt

Robots Exclusion Standard data for hcbb.info

Resource Scan

Scan Details

Site Domain hcbb.info
Base Domain hcbb.info
Scan Status Ok
Last Scan2026-04-06T03:29:04+00:00
Next Scan 2026-04-13T03:29:04+00:00

Last Scan

Scanned2026-04-06T03:29:04+00:00
URL https://hcbb.info/robots.txt
Domain IPs 104.21.50.239, 172.67.213.220, 2606:4700:3035::ac43:d5dc, 2606:4700:3037::6815:32ef
Response IP 172.67.213.220
Found Yes
Hash 42018285cacfbb7be9b137cfe3b2f5719467c27a97b310ee9b75a8dc25dbe70b
SimHash 6500d8926525

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

google-display-ads-bot

Rule Path
Allow /
Disallow /admin/
Disallow /api/admin/
Disallow /*.json$
Allow /articles/
Allow /leaderboard/
Allow /trade/
Allow /player/
Allow /privacy-policy
Allow /terms-of-service

Other Records

Field Value
sitemap https://hcbb.info/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay for respectful crawling
  • Allow all major search engines
  • Allow AdSense crawlers
  • Block access to admin or sensitive areas (if any)
  • Allow access to important pages