userlist.io
robots.txt

Robots Exclusion Standard data for userlist.io

Resource Scan

Scan Details

Site Domain userlist.io
Base Domain userlist.io
Scan Status Ok
Last Scan2025-09-16T10:25:19+00:00
Next Scan 2025-10-16T10:25:19+00:00

Last Scan

Scanned2025-09-16T10:25:19+00:00
URL https://userlist.io/robots.txt
Redirect https://userlist.com/robots.txt
Redirect Domain userlist.com
Redirect Base userlist.com
Domain IPs 2600:1f18:16e:df01::258, 2600:1f18:16e:df01::259, 54.253.94.210
Redirect IPs 2406:da1c:cc9:3500::258, 54.253.94.210
Response IP 18.208.88.157
Found Yes
Hash 4222634ce2a1074642e8696075877a815013cf69a9013343d16b8547fddcc59a
SimHash f9058c44cb93

Groups

*

Rule Path
Disallow /downloads/
Disallow /admin/

Other Records

Field Value
sitemap https://userlist.com/sitemap.xml