newsler.ru
robots.txt
Robots Exclusion Standard data for newsler.ru
Resource Scan
Scan Details
| Site Domain | newsler.ru |
| Base Domain | newsler.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-09T08:55:59+00:00 |
| Next Scan | 2024-11-16T08:55:59+00:00 |
Last Scan
| Scanned | 2024-11-09T08:55:59+00:00 |
| URL | https://newsler.ru/robots.txt |
| Redirect | https://www.newsler.ru/robots.txt |
| Redirect Domain | www.newsler.ru |
| Redirect Base | newsler.ru |
| Domain IPs | 92.39.71.68 |
| Redirect IPs | 92.39.71.68 |
| Response IP | 92.39.71.68 |
| Found | Yes |
| Hash | 2ee0d080059da6e77e59f05bd0dfc17e9584f00084f0a3a4feaa9a052ffc5c10 |
| SimHash | 7348c6c44a1a |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /assets/backup/ |
| Disallow | /assets/cache/ |
| Disallow | /assets/docs/ |
| Disallow | /assets/export/ |
| Disallow | /assets/import/ |
| Disallow | /assets/modules/ |
| Disallow | /assets/plugins/ |
| Disallow | /assets/snippets/ |
| Disallow | /assets/packages/ |
| Disallow | /assets/tvs/ |
| Disallow | /install/ |
| Disallow | /click |
| Disallow | /assets/images/adv/ |
| Disallow | /assets/flash/adv/ |
| Disallow | /assets/files/adv/ |
| Disallow | /assets/images/_nw/ |
| Disallow | /assets/flash/_nw/ |
| Disallow | /assets/files/_nw/ |
| Disallow | /rec-px |
| Disallow | *%26amp* |
| Disallow | *?showme=* |
| Disallow | */amp |
| Disallow | /*?* |
| Disallow | /*%26* |
| Allow | /*?tag=* |
| Allow | *.css* |
| Allow | *.js* |
| Allow | /assets/cache/images/ |
| Allow | /assets/modules/*.css |
| Allow | /assets/modules/*.js |
| Allow | /assets/plugins/*.css |
| Allow | /assets/plugins/*.js |
| Allow | /assets/snippets/*.css |
| Allow | /assets/snippets/*.js |
*
| Rule | Path |
|---|---|
| Disallow | /assets/backup/ |
| Disallow | /assets/cache/ |
| Disallow | /assets/docs/ |
| Disallow | /assets/export/ |
| Disallow | /assets/import/ |
| Disallow | /assets/modules/ |
| Disallow | /assets/plugins/ |
| Disallow | /assets/snippets/ |
| Disallow | /assets/packages/ |
| Disallow | /assets/tvs/ |
| Disallow | /install/ |
| Disallow | /click |
| Disallow | /assets/images/adv/ |
| Disallow | /assets/flash/adv/ |
| Disallow | /assets/files/adv/ |
| Disallow | /assets/images/_nw/ |
| Disallow | /assets/flash/_nw/ |
| Disallow | /assets/files/_nw/ |
| Disallow | /rec-px |
| Disallow | *%26amp* |
| Disallow | *?showme=* |
| Disallow | /*?* |
| Disallow | /*%26* |
| Allow | /*?tag=* |
| Allow | *.css* |
| Allow | *.js* |
| Allow | /assets/cache/images/ |
| Allow | /assets/modules/*.css |
| Allow | /assets/modules/*.js |
| Allow | /assets/plugins/*.css |
| Allow | /assets/plugins/*.js |
| Allow | /assets/snippets/*.css |
| Allow | /assets/snippets/*.js |
Comments