useme.org
robots.txt

Robots Exclusion Standard data for useme.org

Resource Scan

Scan Details

Site Domain useme.org
Base Domain useme.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan5/20/2025, 12:14:31 PM
Next Scan 5/21/2025, 12:14:31 PM

Last Successful Scan

Scanned5/13/2025, 10:34:48 AM
URL https://useme.org/robots.txt
Domain IPs 104.21.9.63, 172.67.159.48, 2606:4700:3031::6815:93f, 2606:4700:3035::ac43:9f30
Response IP 172.67.159.48
Found Yes
Hash 5ce68713e6f9f36732106e8280e29a561870974c6390f83487f67db01b78da35
SimHash 902c9160fb73

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

cutestat

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /