diablo1.ru
robots.txt
Robots Exclusion Standard data for diablo1.ru
Resource Scan
Scan Details
Site Domain | diablo1.ru |
Base Domain | diablo1.ru |
Scan Status | Ok |
Last Scan | 2024-11-19T08:33:21+00:00 |
Next Scan | 2024-11-26T08:33:21+00:00 |
Last Scan
Scanned | 2024-11-19T08:33:21+00:00 |
URL | http://diablo1.ru/robots.txt |
Redirect | https://duskworld.ru/robots.txt |
Redirect Domain | duskworld.ru |
Redirect Base | duskworld.ru |
Domain IPs | 185.105.224.221 |
Redirect IPs | 185.105.224.221 |
Response IP | 185.105.224.221 |
Found | Yes |
Hash | 7e9c551f87b7a72586535509e4bed49dbad8bf30c692feeeef98df01a1724d7c |
SimHash | dd60e4e25db0 |
Groups
*
Rule | Path |
---|---|
Disallow | /witcher2/Game_Guide.pdf |
Disallow | /witcher2/Map.pdf |
Disallow | /ratingit |
Disallow | /images/*.html |
Disallow | /commentit/* |
Warnings
- `host` is not a known field.