Log In Sign Up

highbrand.site
robots.txt

Robots Exclusion Standard data for highbrand.site

Resource Scan

Scan Details

Site Domain highbrand.site
Base Domain highbrand.site
Scan Status Ok
Last Scan2025-11-26T15:48:30+00:00
Next Scan 2025-12-03T15:48:30+00:00

Last Scan

Scanned2025-11-26T15:48:30+00:00
URL https://highbrand.site/robots.txt
Redirect https://www.highbrand.site/robots.txt
Redirect Domain www.highbrand.site
Redirect Base highbrand.site
Domain IPs 104.21.41.112, 172.67.164.114, 2606:4700:3032::6815:2970, 2606:4700:3033::ac43:a472
Redirect IPs 104.21.41.112, 172.67.164.114, 2606:4700:3032::6815:2970, 2606:4700:3033::ac43:a472
Response IP 104.21.41.112
Found Yes
Hash 8532c7d47af56bb665f721bd67790070361e5a7e9ca55ec5c43864ceedf13f1d
SimHash 211f9941c270

Groups

*

Rule Path
Disallow /search
Disallow /downloads/
Disallow /uploads/
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

magicsearchbot

Rule Path
Disallow /uploads/
Back to top

Other Records

Field Value
sitemap https://www.highbrand.site/sitemap.xml
Back to top

Comments

  • ================================
  • Robots.txt for https://www.highbrand.site
  • Optimized for Blogger + Google SEO
  • and AI Bot Protection (Claude, GPT, Meta, etc.)
  • ================================
  • Allow Ads and Images Crawlers
  • Sitemap
  • ================================
  • Block AI data-scraping bots
  • ================================
  • ================================
  • Block specific custom bot
  • ================================
Back to top