Log In Sign Up

bradyunited.org
robots.txt

Robots Exclusion Standard data for bradyunited.org

Resource Scan

Scan Details

Site Domain bradyunited.org
Base Domain bradyunited.org
Scan Status Ok
Last Scan4/19/2025, 9:07:38 PM
Next Scan 4/26/2025, 9:07:38 PM

Last Scan

Scanned4/19/2025, 9:07:38 PM
URL https://bradyunited.org/robots.txt
Redirect https://www.bradyunited.org/robots.txt
Redirect Domain www.bradyunited.org
Redirect Base bradyunited.org
Domain IPs 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91
Redirect IPs 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91
Response IP 172.66.40.111
Found Yes
Hash 4831599af687ddb06fa23b38c1a78a1873becb82364833c90909eb9d2b07c3f9
SimHash a17c1922c777

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bradyunited.org/sitemaps-1-sitemap.xml
sitemap https://content.craft5.thebradycenter.net/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.bradyunited.org/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site
  • Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site
Back to top