probnick.ru
robots.txt
Robots Exclusion Standard data for probnick.ru
Resource Scan
Scan Details
| Site Domain | probnick.ru |
| Base Domain | probnick.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-24T18:04:44+00:00 |
| Next Scan | 2024-11-23T18:04:44+00:00 |
Last Scan
| Scanned | 2024-10-24T18:04:44+00:00 |
| URL | https://probnick.ru/robots.txt |
| Domain IPs | 45.130.41.31 |
| Response IP | 45.130.41.31 |
| Found | Yes |
| Hash | 675999a07eb2248461d027e701b544244bdba78d42e07d57550fb84d85be9b07 |
| SimHash | 2231d8f2e282 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin/ |
| Disallow | /login/ |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | /author/ |
| Disallow | /feed/ |
| Disallow | /page/ |
| Disallow | */feed |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | */?p* |
| Disallow | /?m=* |
| Disallow | /?s=* |
| Disallow | */embed* |
| Disallow | */wp-json/* |
| Disallow | *utm%3D |
| Disallow | /awstats/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin/ |
| Disallow | /login/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | /category/* |
| Disallow | /author/* |
| Disallow | /feed/* |
| Disallow | /tag/* |
| Disallow | /page/* |
| Disallow | */feed |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | */?p* |
| Disallow | /2013/* |
| Disallow | /2014/* |
| Disallow | /2015/* |
| Disallow | /2016/* |
| Disallow | /2017/* |
| Disallow | /2018/* |
| Disallow | /2019/* |
| Disallow | /2020/* |
| Disallow | /?m=* |
| Disallow | /?s=* |
| Disallow | */embed* |
| Disallow | */wp-json/* |
| Disallow | /awstats/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://probnick.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.