bahaiforums.com
robots.txt
Robots Exclusion Standard data for bahaiforums.com
Resource Scan
Scan Details
Site Domain | bahaiforums.com |
Base Domain | bahaiforums.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 3/28/2025, 3:59:20 AM |
Next Scan | 6/26/2025, 3:59:20 AM |
Last Successful Scan
Scanned | 9/2/2023, 12:14:20 PM |
URL | https://bahaiforums.com/robots.txt |
Domain IPs | 104.21.33.30, 172.67.140.189, 2606:4700:3030::6815:211e, 2606:4700:3030::ac43:8cbd |
Response IP | 172.67.140.189 |
Found | Yes |
Hash | c5bc32945e2a791cbb7c4802e7f34451258c6c3c62aeedaf57da01e114880bef |
SimHash | 2f7b5961af00 |
Groups
*
Rule | Path |
---|---|
Disallow | /login/ |
Disallow | /register/ |
Disallow | /lost-password/ |
Disallow | /members/ |
Disallow | /account/ |
Disallow | /conversations/ |
Disallow | /help/ |
Disallow | /help/bb-codes/ |
Disallow | /help/smilies/ |
Disallow | /help/terms/ |
Disallow | /help/privacy-policy/ |
Disallow | /terms/ |
Disallow | /privacy/ |
Disallow | /misc/contact |
Disallow | /contact/ |
Disallow | /admin.php |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://bahaiforums.com/sitemap.xml |