brightfutures.org
robots.txt

Robots Exclusion Standard data for brightfutures.org

Resource Scan

Scan Details

Site Domain brightfutures.org
Base Domain brightfutures.org
Scan Status Ok
Last Scan2025-08-13T20:07:46+00:00
Next Scan 2025-09-12T20:07:46+00:00

Last Scan

Scanned2025-08-13T20:07:46+00:00
URL https://brightfutures.org/robots.txt
Redirect https://www.brightfutures.org/robots.txt
Redirect Domain www.brightfutures.org
Redirect Base brightfutures.org
Domain IPs 104.21.36.141, 172.67.194.218, 2606:4700:3031::ac43:c2da, 2606:4700:3034::6815:248d
Redirect IPs 104.21.36.141, 172.67.194.218, 2606:4700:3031::ac43:c2da, 2606:4700:3034::6815:248d
Response IP 104.21.36.141
Found Yes
Hash 869f670ba49a9b81bd5ffab17bb0fb824008c9125bc33b707dc20db6e62f1389
SimHash 4c565212c7a7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebot

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

naverbot

Rule Path
Allow /

seznambot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Allow /

yeti

Rule Path
Allow /

*

Rule Path
Disallow /