scottlet.org
robots.txt
Robots Exclusion Standard data for scottlet.org
Resource Scan
Scan Details
Site Domain | scottlet.org |
Base Domain | scottlet.org |
Scan Status | Ok |
Last Scan | 2025-08-16T16:18:09+00:00 |
Next Scan | 2025-09-15T16:18:09+00:00 |
Last Scan
Scanned | 2025-08-16T16:18:09+00:00 |
URL | https://scottlet.org/robots.txt |
Redirect | https://www.scottlet.org/robots.txt |
Redirect Domain | www.scottlet.org |
Redirect Base | scottlet.org |
Redirect IPs | 104.21.6.184, 172.67.155.44, 2606:4700:3031::ac43:9b2c, 2606:4700:3033::6815:6b8 |
Response IP | 172.67.155.44 |
Found | Yes |
Hash | 3d0cf0704aa9015cd47c7a106b9b22d2f272dc0a75b67ebf41442ea7d13c89a1 |
SimHash | e0045505ed13 |
Groups
*
Rule | Path |
---|---|
Disallow | /ghost/ |
Disallow | /email/ |
Disallow | /members/api/comments/counts/ |
Disallow | /r/ |
Disallow | /webmentions/receive/ |
Other Records
Field | Value |
---|---|
sitemap | https://scottlet.org/sitemap.xml |