disk.st
robots.txt

Robots Exclusion Standard data for disk.st

Resource Scan

Scan Details

Site Domain disk.st
Base Domain disk.st
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/15/2025, 5:18:51 PM
Next Scan 7/14/2025, 5:18:51 PM

Last Successful Scan

Scanned11/24/2024, 4:04:46 PM
URL https://disk.st/robots.txt
Domain IPs 104.21.77.25, 172.67.203.223, 2606:4700:3036::6815:4d19, 2606:4700:3036::ac43:cbdf
Response IP 104.21.77.25
Found Yes
Hash 44f3f8eafdf064cf69acb05f23ee4dfc9ab5b3d67d81c64246bc29f7e438789a
SimHash 4150c1524731

Groups

*

Rule Path
Allow /