kaliningradnews.ru
robots.txt
Robots Exclusion Standard data for kaliningradnews.ru
Resource Scan
Scan Details
| Site Domain | kaliningradnews.ru |
| Base Domain | kaliningradnews.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-07T03:49:38+00:00 |
| Next Scan | 2024-06-14T03:49:38+00:00 |
Last Scan
| Scanned | 2024-06-07T03:49:38+00:00 |
| URL | https://kaliningradnews.ru/robots.txt |
| Domain IPs | 95.217.18.13 |
| Response IP | 95.217.18.13 |
| Found | Yes |
| Hash | 7d9e59455928598d2f4479aa923c4e114917663aff12d16f188cfddf48c37030 |
| SimHash | 582f4ccaa698 |
Groups
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/fast/2.0; +http://go.mail.ru/help/robots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)
| Rule | Path |
|---|---|
| Disallow | / |
domaincrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/kaliningradnews.ru)
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/cache/ |
| Disallow | /index.php?p=75018 |
| Disallow | /?p=75018 |
| Disallow | /index.php?p=66677 |
| Disallow | /?p=66677 |
| Disallow | /?p=110310 |
| Disallow | /index.php?p=110310 |
| Disallow | /index.php?p=134117 |
| Disallow | /?p=134117 |
| Disallow | /index.php?p=134286 |
| Disallow | /?p=134286 |
| Disallow | /?p=161944 |
| Disallow | /index.php?p=161944 |
| Disallow | /?p=163225 |
| Disallow | /index.php?p=163225 |
| Disallow | /?p=173016 |
| Disallow | /index.php?p=173016 |
| Disallow | /?p=174010 |
| Disallow | /index.php?p=174010 |
| Disallow | /?p=174419 |
| Disallow | /index.php?p=174419 |
| Disallow | /?p=174786 |
| Disallow | /index.php?p=174786 |
| Disallow | /?p=176005 |
| Disallow | /index.php?p=176005 |
| Disallow | /?p=175267 |
| Disallow | /index.php?p=175267 |
| Disallow | /?p=182110 |
| Disallow | /index.php?p=182110 |
| Disallow | /wstat |
| Disallow | /cgi-bin |
| Disallow | /wp-login.php |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /?author=* |
| Disallow | /193389 |
| Disallow | /wp-json |
| Disallow | /wp-json/ |
| Disallow | */trackback/ |
| Disallow | */comments/ |
| Disallow | /?s= |
| Disallow | /*p%3D |
| Disallow | /ehkonomika/13109600/ |
| Disallow | /ehkonomika/13109600 |
| Disallow | /ehkonomika/30111099/ |
| Disallow | /ehkonomika/30111099/ |
| Disallow | /ehkonomika/05115961 |
| Disallow | /ehkonomika/05115961/ |
| Disallow | /kaliningrad/10119212/ |
| Disallow | /kaliningrad/10119212 |
| Disallow | /ehkonomika/14119932/ |
| Disallow | /ehkonomika/14119932 |
| Disallow | /ehkonomika/07123299 |
| Disallow | /ehkonomika/07123299/ |
| Disallow | /ehkonomika/13123381 |
| Disallow | /ehkonomika/13123381/ |
| Disallow | /ehkonomika/09123781 |
| Disallow | /ehkonomika/09123781/ |
| Disallow | /kriminal-i-proisshestviya/03124863 |
| Disallow | /kriminal-i-proisshestviya/03124863/ |
| Disallow | /ehkonomika/11126063 |
| Disallow | /ehkonomika/11126063/ |
| Disallow | /politika/vlast/03126749 |
| Disallow | /politika/vlast/03126749/ |
| Disallow | /obshhestvo/siloviki/03128384 |
| Disallow | /obshhestvo/siloviki/03128384/ |
| Disallow | /ehkonomika/29128980 |
| Disallow | /ehkonomika/29128980/ |
| Disallow | /ehkonomika/21131277 |
| Disallow | /ehkonomika/21131277/ |
| Disallow | /ehkonomika/19134822 |
| Disallow | /ehkonomika/19134822/ |
| Disallow | /ehkonomika/02134996 |
| Disallow | /ehkonomika/02134996/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://kaliningradnews.ru/sitemap_index.xml |