justmind.org
robots.txt

Robots Exclusion Standard data for justmind.org

Resource Scan

Scan Details

Site Domain justmind.org
Base Domain justmind.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-10T21:42:54+00:00
Next Scan 2025-09-08T21:42:54+00:00

Last Successful Scan

Scanned2024-07-23T21:17:27+00:00
URL https://justmind.org/robots.txt
Domain IPs 104.21.22.48, 172.67.202.239, 2606:4700:3032::6815:1630, 2606:4700:3033::ac43:caef
Response IP 104.21.22.48
Found Yes
Hash 6811c23577e7b4011a97945ce04e7f0dda24732ae12ec7fe58b3f0cc3ba6e59c
SimHash e01d3284c7f0

Groups

*

Rule Path
Disallow /

bingbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

*

Rule Path
Disallow */feed/
Disallow /ufaqs*/
Disallow /tag*/

Comments

  • Prevent RSS feed, ufaq and tag URLs from getting indexed