dni24.com
robots.txt
Robots Exclusion Standard data for dni24.com
Resource Scan
Scan Details
| Site Domain | dni24.com |
| Base Domain | dni24.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T15:07:55+00:00 |
| Next Scan | 2024-11-21T15:07:55+00:00 |
Last Scan
| Scanned | 2024-11-14T15:07:55+00:00 |
| URL | https://dni24.com/robots.txt |
| Domain IPs | 91.206.14.109 |
| Response IP | 91.206.14.109 |
| Found | Yes |
| Hash | 873e6a4efabc4f06e925150271bd87f0a32ec27fa9ec7e20786145cc1bd8f55d |
| SimHash | 7d28a179e921 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /user/ |
| Disallow | /*/page/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dlastnews |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /go/ |
| Disallow | /url/ |
| Disallow | *coupon* |
| Disallow | /xgo.php |
| Disallow | /xgo1.php |
| Disallow | /20*/*/*/ |
| Disallow | /?page=* |
| Disallow | /?type* |
Warnings
- `host` is not a known field.