subscene.icu
robots.txt
Robots Exclusion Standard data for subscene.icu
Resource Scan
Scan Details
Site Domain | subscene.icu |
Base Domain | subscene.icu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-25T19:52:24+00:00 |
Next Scan | 2024-06-23T19:52:24+00:00 |
Last Successful Scan
Scanned | 2023-08-28T03:11:27+00:00 |
URL | https://subscene.icu/robots.txt |
Domain IPs | 104.21.11.46, 172.67.165.38, 2606:4700:3034::ac43:a526, 2606:4700:3037::6815:b2e |
Response IP | 104.21.11.46 |
Found | Yes |
Hash | 45e409db71c17cf9e56b6facace8c2281f46f34d082db1c9f0897a8e9f3b6d2e |
SimHash | bd40dd04adf7 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.txt$ |
Disallow | /*.rar$ |
Disallow | /*.zip$ |
Disallow | /*undefined$ |