dogi.ru
robots.txt
Robots Exclusion Standard data for dogi.ru
Resource Scan
Scan Details
| Site Domain | dogi.ru |
| Base Domain | dogi.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-12T15:05:19+00:00 |
| Next Scan | 2024-11-10T15:05:19+00:00 |
Last Successful Scan
| Scanned | 2023-09-25T07:35:47+00:00 |
| URL | http://dogi.ru/robots.txt |
| Redirect | http://www.dogi.ru/robots.txt |
| Redirect Domain | www.dogi.ru |
| Redirect Base | dogi.ru |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:e7e9, 2a00:15f8:a000:5:1:12:0:e7e9, 2a00:15f8:a000:5:1:13:0:e7e9, 2a00:15f8:a000:5:1:14:0:e7e9, 90.156.201.44, 90.156.201.49, 90.156.201.71, 90.156.201.76 |
| Redirect IPs | 2a00:15f8:a000:5:1:11:0:e7e9, 2a00:15f8:a000:5:1:12:0:e7e9, 2a00:15f8:a000:5:1:13:0:e7e9, 2a00:15f8:a000:5:1:14:0:e7e9, 90.156.201.44, 90.156.201.49, 90.156.201.71, 90.156.201.76 |
| Response IP | 90.156.201.49 |
| Found | Yes |
| Hash | ccc6561afa338a088d9619f12d664d5c1885b2378a661a629835ee6dee6fbdf2 |
| SimHash | fd0db5784133 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |