itzine.ru
robots.txt
Robots Exclusion Standard data for itzine.ru
Resource Scan
Scan Details
| Site Domain | itzine.ru |
| Base Domain | itzine.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-03T11:05:59+00:00 |
| Next Scan | 2024-10-10T11:05:59+00:00 |
Last Scan
| Scanned | 2024-10-03T11:05:59+00:00 |
| URL | https://itzine.ru/robots.txt |
| Domain IPs | 2a01:4f8:c012:9085::1, 65.21.183.89 |
| Response IP | 65.21.183.89 |
| Found | Yes |
| Hash | f64e3e082a08505dc5eec855cd44fcc4973dcac0c053967d3641258a74aa15ea |
| SimHash | 3c0cdae28870 |
Groups
*
| Product | Comment |
|---|---|
| * | общие правила для роботов, кроме Яндекса и Google, |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | папка на хостинге |
| Disallow | /? | все параметры запроса на главной |
| Disallow | /wp- | все файлы WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | поиск |
| Disallow | *%26s%3D | поиск |
| Disallow | /search/ | поиск |
| Disallow | *?nw | - |
| Disallow | *?amp* | - |
| Disallow | /author/ | архив автора |
| Disallow | /users/ | архив авторов |
| Disallow | */trackback | трекбеки, уведомления в комментариях о появлении открытой ссылки на статью |
| Disallow | */rss | rss фид |
| Disallow | */embed | все встраивания |
| Disallow | /xmlrpc.php | файл WordPress API |
| Disallow | *utm*%3D | ссылки с utm-метками |
| Disallow | *openstat%3D | ссылки с метками openstat |
| Disallow | /goto/* | - |
| Allow | */uploads | открываем папку с файлами uploads |
| Allow | */amp* | - |
| Allow | /feed/turbo/* | - |
| Allow | /yandex/turbo/* | - |
| Allow | /yandex/news/* | - |
| Allow | /yandex/* | - |
| Allow | /feed/* | - |
| Allow | */?yandex_feed=news | - |
| Allow | */sitemap_index.xml | - |
| Disallow | */-* | - |
| Disallow | /* | - |
| Allow | /advertisment | - |
| Allow | /job | - |
| Allow | /about | - |
| Allow | /contacts | - |
| Allow | /news | - |
| Allow | /reviews | - |
| Allow | /games | - |
| Allow | /soft | - |
| Allow | /smthelse | - |
| Allow | /tag | - |
| Allow | /wp-content/uploads/* | - |
| Allow | /iphone-11 | - |
| Allow | /medals | - |
| Allow | /yandex-reviews | - |
| Allow | /gdpr | - |
| Allow | /$ | - |
| Allow | /?$ | - |
| Allow | /sitemap_index.xml | - |
| Allow | /post-sitemap*.xml | - |
| Allow | /page-sitemap*.xml | - |
| Allow | /category-sitemap*.xml | - |
| Allow | /sitemap-news.xml | - |
| Allow | /yandex/news2 | - |
| Allow | /feed/zen/ | - |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | - |
| Disallow | /? | - |
| Disallow | /wp- | - |
| Disallow | /wp/ | - |
| Disallow | *?s= | - |
| Disallow | *%26s%3D | - |
| Disallow | /search/ | - |
| Disallow | /author/ | - |
| Disallow | /users/ | - |
| Disallow | */trackback | - |
| Allow | */feed | - |
| Disallow | */rss | - |
| Disallow | */embed | - |
| Disallow | */wlwmanifest.xml | - |
| Disallow | /xmlrpc.php | - |
| Disallow | *utm*%3D | - |
| Disallow | *openstat%3D | - |
| Disallow | /goto/* | - |
| Disallow | *?nw | - |
| Disallow | *?amp* | - |
| Allow | */amp | - |
| Allow | */amp* | - |
| Allow | */uploads | - |
| Allow | /*/*.js | открываем js-скрипты внутри /wp- (/*/ - для приоритета) |
| Allow | /*/*.css | открываем css-файлы внутри /wp- (/*/ - для приоритета) |
| Allow | /wp-*.png | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpeg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.gif | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.webp | - |
| Allow | /wp-admin/admin-ajax.php | используется плагинами, чтобы не блокировать JS и CSS |
| Allow | /ads.txt | для рекламы |
| Disallow | */-* | - |
| Allow | /advertisment | - |
| Allow | /job | - |
| Allow | /about | - |
| Allow | /contacts | - |
| Allow | /news | - |
| Allow | /reviews | - |
| Allow | /games | - |
| Allow | /soft | - |
| Allow | /smthelse | - |
| Allow | /tag | - |
| Allow | /wp-content/uploads/* | - |
| Allow | /iphone-11 | - |
| Allow | /medals | - |
| Allow | /yandex-reviews | - |
| Allow | /gdpr | - |
| Allow | /$ | - |
| Allow | /?$ | - |
| Allow | /sitemap_index.xml | - |
| Allow | /post-sitemap*.xml | - |
| Allow | /page-sitemap*.xml | - |
| Allow | /category-sitemap*.xml | - |
| Allow | /sitemap-news.xml | - |
| Allow | /yandex/news2 | - |
| Allow | /feed/zen/ | - |
| Disallow | /* | - |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /? |
| Disallow | /wp- |
| Disallow | /wp/ |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search/ |
| Disallow | /users/ |
| Disallow | */trackback |
| Disallow | */embed |
| Disallow | */wlwmanifest.xml |
| Disallow | /xmlrpc.php |
| Disallow | /goto/* |
| Allow | /feed |
| Allow | */feed |
| Allow | /feed/turbo/ |
| Allow | /feed/turbo/* |
| Allow | /yandex/turbo/* |
| Allow | /yandex/news/* |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.webp |
| Allow | /wp-admin/admin-ajax.php |
| Allow | */?yandex_feed=news |
| Allow | /yandex/* |
| Allow | /feed/* |
| Disallow | */-* |
| Disallow | /* |
| Allow | /advertisment |
| Allow | /job |
| Allow | /about |
| Allow | /contacts |
| Allow | /news |
| Allow | /reviews |
| Allow | /games |
| Allow | /soft |
| Allow | /smthelse |
| Allow | /tag |
| Allow | /wp-content/uploads/* |
| Allow | /iphone-11 |
| Allow | /medals |
| Allow | /yandex-reviews |
| Allow | /gdpr |
| Allow | /$ |
| Allow | /?$ |
| Allow | /sitemap_index.xml |
| Allow | /post-sitemap*.xml |
| Allow | /page-sitemap*.xml |
| Allow | /category-sitemap*.xml |
| Allow | /sitemap-news.xml |
| Allow | /yandex/news2 |
| Allow | /feed/zen/ |
yandexnews
| Rule | Path |
|---|---|
| Allow | * |
| Allow | /feed |
| Allow | */feed |
| Allow | /feed/turbo/ |
| Allow | /feed/turbo/* |
| Allow | */feed/yandex/ |
| Allow | */yandex/news/ |
| Allow | */?yandex_feed=news |
| Allow | */?feed=rss2 |
| Allow | */?feed |
| Allow | /yandex/* |
| Allow | /feed/* |
| Disallow | */-* |
| Disallow | /* |
| Allow | /advertisment |
| Allow | /job |
| Allow | /about |
| Allow | /contacts |
| Allow | /news |
| Allow | /reviews |
| Allow | /games |
| Allow | /soft |
| Allow | /smthelse |
| Allow | /tag |
| Allow | /wp-content/uploads/* |
| Allow | /iphone-11 |
| Allow | /medals |
| Allow | /yandex-reviews |
| Allow | /gdpr |
| Allow | /$ |
| Allow | /?$ |
| Allow | /sitemap_index.xml |
| Allow | /post-sitemap*.xml |
| Allow | /page-sitemap*.xml |
| Allow | /category-sitemap*.xml |
| Allow | /sitemap-news.xml |
| Allow | /yandex/news2 |
| Allow | /feed/zen/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://itzine.ru/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
Comments