bahaiforums.com
robots.txt

Robots Exclusion Standard data for bahaiforums.com

Resource Scan

Scan Details

Site Domain bahaiforums.com
Base Domain bahaiforums.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/28/2025, 3:59:20 AM
Next Scan 6/26/2025, 3:59:20 AM

Last Successful Scan

Scanned9/2/2023, 12:14:20 PM
URL https://bahaiforums.com/robots.txt
Domain IPs 104.21.33.30, 172.67.140.189, 2606:4700:3030::6815:211e, 2606:4700:3030::ac43:8cbd
Response IP 172.67.140.189
Found Yes
Hash c5bc32945e2a791cbb7c4802e7f34451258c6c3c62aeedaf57da01e114880bef
SimHash 2f7b5961af00

Groups

*

Rule Path
Disallow /login/
Disallow /register/
Disallow /lost-password/
Disallow /members/
Disallow /account/
Disallow /conversations/
Disallow /help/
Disallow /help/bb-codes/
Disallow /help/smilies/
Disallow /help/terms/
Disallow /help/privacy-policy/
Disallow /terms/
Disallow /privacy/
Disallow /misc/contact
Disallow /contact/
Disallow /admin.php
Allow /

Other Records

Field Value
sitemap https://bahaiforums.com/sitemap.xml