itcrumbs.ru
robots.txt
Robots Exclusion Standard data for itcrumbs.ru
Resource Scan
Scan Details
| Site Domain | itcrumbs.ru |
| Base Domain | itcrumbs.ru |
| Scan Status | Ok |
| Last Scan | 2026-01-30T14:55:38+00:00 |
| Next Scan | 2026-02-06T14:55:38+00:00 |
Last Scan
| Scanned | 2026-01-30T14:55:38+00:00 |
| URL | https://itcrumbs.ru/robots.txt |
| Domain IPs | 83.220.172.3 |
| Response IP | 83.220.172.3 |
| Found | Yes |
| Hash | 5e2f5f2d094061bae366a777faa4d0d7511da85c613c63a7ba2197ed2a336f94 |
| SimHash | 681c45809452 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/*.jpg |
| Disallow | /wp-content/uploads/*.jpeg |
| Disallow | /wp-content/uploads/*.png |
| Disallow | /wp-content/uploads/*.gif |
| Disallow | /wp-content/uploads/*.webp |
| Disallow | *?$ |
| Disallow | */amp* |
| Disallow | *?amp* |
| Disallow | /author/* |
| Allow | /feed/zen/ |
| Allow | /?yandex_feed=news |
| Allow | /feed/turbo/ |
| Allow | /feed/turbo/?paged=* |
| Disallow | *admitad_category* |
| Disallow | *admitad_goods* |
| Disallow | /feed/mihdan-mailru-pulse-feed/ |
| Disallow | /wp-json/* |
| Disallow | /myredir.php* |
| Disallow | /wp-login.php* |
| Disallow | /wp-register.php* |
| Disallow | /webstat/* |
| Disallow | */trackback |
| Allow | /*?period* |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/themes |
| Disallow | /wp-content/cache |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /share42/ |
| Disallow | /y/ |
| Disallow | /files/ |
| Disallow | /orphus/ |
| Disallow | /link/ |
| Disallow | /daos/ |
| Disallow | /op/ |
| Disallow | /best/ |
| Disallow | /friends/ |
| Disallow | /i/ |
| Disallow | /icons/ |
| Disallow | /marafon/ |
| Disallow | /tur/ |
| Disallow | /tag/ |
| Disallow | /go/ |
| Disallow | */embed |
| Disallow | *optad360 |
| Disallow | *?frequency=* |
| Disallow | *?lor_secret=* |
| Disallow | /myadmin?redirect_to=* |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/*.jpg |
| Disallow | /wp-content/uploads/*.jpeg |
| Disallow | /wp-content/uploads/*.png |
| Disallow | /wp-content/uploads/*.gif |
| Disallow | /wp-content/uploads/*.webp |
| Disallow | *admitad_category* |
| Disallow | *?amp%2Fpage%2F* |
| Disallow | *utm* |
| Disallow | /wp-json/ |
| Disallow | /myredir.php* |
| Disallow | /wp-register.php* |
| Disallow | /myadmin?redirect_to=* |
| Disallow | /webstat/ |
| Disallow | */trackback |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/themes |
| Disallow | /wp-content/cache |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /share42/ |
| Disallow | /y/ |
| Disallow | /files/ |
| Disallow | /orphus/ |
| Disallow | /link/ |
| Disallow | /daos/ |
| Disallow | /op/ |
| Disallow | *?$ |
| Disallow | */search/* |
| Disallow | /best/ |
| Disallow | /friends/ |
| Disallow | /i/ |
| Disallow | /icons/ |
| Disallow | /marafon/ |
| Disallow | /tur/ |
| Disallow | /go/ |
| Disallow | */embed |
| Disallow | *optad360 |
| Disallow | *?frequency=* |
| Disallow | /igrovyie-avtomatyi |
| Disallow | *?lor_secret=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://itcrumbs.ru/sitemap_index.xml |
| sitemap | https://itcrumbs.ru/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.