communityfutures.ca
robots.txt

Robots Exclusion Standard data for communityfutures.ca

Resource Scan

Scan Details

Site Domain communityfutures.ca
Base Domain communityfutures.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-06T04:14:35+00:00
Next Scan 2025-10-13T04:14:35+00:00

Last Successful Scan

Scanned2025-09-04T20:59:38+00:00
URL https://communityfutures.ca/robots.txt
Domain IPs 2605:6f00:1234:700:1::2a3, 66.102.133.37
Response IP 66.102.133.37
Found Yes
Hash dc28333f7220b51668a1bd025e5e98b033a41ccc0c73c3345c66fb754c406dbb
SimHash ab1dc0604810

Groups

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

googlebot

Rule Path
Allow *.css
Allow *.less.css
Allow *.js

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/

Other Records

Field Value
sitemap https://www.communityfutures.ca/component/osmap/?view=xml&id=1&format=xml

Comments

  • Googlebot