Log In Sign Up

beafreemason.org
robots.txt

Robots Exclusion Standard data for beafreemason.org

Resource Scan

Scan Details

Site Domain beafreemason.org
Base Domain beafreemason.org
Scan Status Ok
Last Scan2026-02-21T19:47:00+00:00
Next Scan 2026-02-28T19:47:00+00:00

Last Scan

Scanned2026-02-21T19:47:00+00:00
URL https://beafreemason.org/robots.txt
Domain IPs 104.26.10.34, 104.26.11.34, 172.67.74.131, 2606:4700:20::681a:a22, 2606:4700:20::681a:b22, 2606:4700:20::ac43:4a83
Response IP 104.26.10.34
Found Yes
Hash f3a18eaad19645c465682a04ad9f1c7e3813eca880ea0d7087289f76051f4915
SimHash e19c9b2a4f36

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://beafreemason.org/sitemaps-3-sitemap.xml
Back to top

Comments

  • robots.txt for https://beafreemason.org/
  • default - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site
  • Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site
  • Disallow Perplexity bot, as there's no benefit to allowing it to index your site
Back to top