Log In Sign Up

bebolddigital.com
robots.txt

Robots Exclusion Standard data for bebolddigital.com

Resource Scan

Scan Details

Site Domain bebolddigital.com
Base Domain bebolddigital.com
Scan Status Ok
Last Scan2025-11-24T17:44:46+00:00
Next Scan 2025-12-24T17:44:46+00:00

Last Scan

Scanned2025-11-24T17:44:46+00:00
URL https://bebolddigital.com/robots.txt
Redirect https://www.bebolddigital.com/robots.txt
Redirect Domain www.bebolddigital.com
Redirect Base bebolddigital.com
Domain IPs 199.60.103.180, 199.60.103.80
Redirect IPs 199.60.103.2, 199.60.103.254, 2606:2c40::c73c:6702, 2606:2c40::c73c:67fe
Response IP 199.60.103.254
Found Yes
Hash c1f6cc0ce82bc14cf58cbe224c176eb41f35f8aa63fdb03805027d0006a438b2
SimHash 49a98f51c4b3

Groups

*

Rule Path
Disallow /hs-search-results
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Disallow /admin/
Disallow /internal/
Disallow /*?*
Allow /assets/
Allow /static/

googlebot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

bingbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

ahrefsbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

gptbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

chatgpt-user

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

oai-searchbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

perplexitybot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

firecrawlagent

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

andibot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

exabot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

phindbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

ccbot

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Back to top

Other Records

Field Value
sitemap www.bebolddigital.com/sitemap.xml
Back to top

Comments

  • robots.txt for BeBold Digital
  • ==============================
  • General Crawl Rules (All Bots)
  • ==============================
  • ==============================
  • SEO & Analytics Bots (Allowed with Limited Restrictions)
  • ==============================
  • ==============================
  • AI / LLM Bots (Explicitly Allowed, with Same Disallow Rules)
  • ==============================
  • ==============================
  • Blocked Bot (CCBot Only)
  • ==============================
  • ==============================
  • Sitemap Location
  • ==============================
Back to top