probnick.ru
robots.txt
Robots Exclusion Standard data for probnick.ru
Resource Scan
Scan Details
Site Domain | probnick.ru |
Base Domain | probnick.ru |
Scan Status | Ok |
Last Scan | 2024-05-27T18:03:35+00:00 |
Next Scan | 2024-06-26T18:03:35+00:00 |
Last Scan
Scanned | 2024-05-27T18:03:35+00:00 |
URL | https://probnick.ru/robots.txt |
Domain IPs | 45.130.41.31 |
Response IP | 45.130.41.31 |
Found | Yes |
Hash | dd5a5a111cd3292b06bcabfbcfd9e3fae5a3075e9e982fa2c1b9c0dfd6490826 |
SimHash | 223158f2e282 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin/ |
Disallow | /login/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | /author/ |
Disallow | /feed/ |
Disallow | /page/ |
Disallow | */feed |
Disallow | */trackback |
Disallow | */comments |
Disallow | */?p* |
Disallow | /?m=* |
Disallow | /?s=* |
Disallow | */embed* |
Disallow | */wp-json/* |
Disallow | *utm%3D |
Disallow | /awstats/* |
yandex
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin/ |
Disallow | /login/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/cache/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | /category/* |
Disallow | /author/* |
Disallow | /feed/* |
Disallow | /tag/* |
Disallow | /page/* |
Disallow | */feed |
Disallow | */trackback |
Disallow | */comments |
Disallow | */?p* |
Disallow | /2013/* |
Disallow | /2014/* |
Disallow | /2015/* |
Disallow | /2016/* |
Disallow | /2017/* |
Disallow | /2018/* |
Disallow | /2019/* |
Disallow | /2020/* |
Disallow | /?m=* |
Disallow | /?s=* |
Disallow | */embed* |
Disallow | */wp-json/* |
Disallow | /awstats/* |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Other Records
Field | Value |
---|---|
sitemap | https://probnick.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.