3reef.com
robots.txt

Robots Exclusion Standard data for 3reef.com

Resource Scan

Scan Details

Site Domain 3reef.com
Base Domain 3reef.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-08T01:56:11+00:00
Next Scan 2025-12-15T01:56:11+00:00

Last Successful Scan

Scanned2025-11-05T14:24:10+00:00
URL https://3reef.com/robots.txt
Redirect http://www.3reef.com/robots.txt
Redirect Domain www.3reef.com
Redirect Base 3reef.com
Domain IPs 104.21.10.246, 172.67.164.213, 2606:4700:3030::6815:af6, 2606:4700:3033::ac43:a4d5
Redirect IPs 104.21.10.246, 172.67.164.213, 2606:4700:3030::6815:af6, 2606:4700:3033::ac43:a4d5
Response IP 104.21.10.246
Found Yes
Hash 76c2b27e299012de439c8815f9147ba54c08d0bdbda556f402e07e4681b2f398
SimHash 2e5ada72cb25

Groups

*

Rule Path
Disallow /find-new/
Disallow /account/
Disallow /attachments/
Disallow /goto/
Disallow /login/
Disallow /members/
Disallow /posts/
Disallow /conversations/
Disallow /admin.php
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1