spelunky.fyi
robots.txt
Robots Exclusion Standard data for spelunky.fyi
Resource Scan
Scan Details
Site Domain | spelunky.fyi |
Base Domain | spelunky.fyi |
Scan Status | Ok |
Last Scan | 4/19/2025, 12:30:37 AM |
Next Scan | 4/26/2025, 12:30:37 AM |
Last Scan
Scanned | 4/19/2025, 12:30:37 AM |
URL | https://spelunky.fyi/robots.txt |
Domain IPs | 104.21.33.138, 172.67.190.31, 2606:4700:3033::6815:218a, 2606:4700:3037::ac43:be1f |
Response IP | 104.21.33.138 |
Found | Yes |
Hash | c594043936808516a8647761a3b816d7068a0f397bc17686e8c07a9db30598d5 |
SimHash | 0c55cd42f791 |
Groups
*
Rule | Path |
---|---|
Disallow | /mods/m/*/download/* |
Disallow | /accounts/*/login/* |
Disallow | /accounts/*/login |