itzine.ru
robots.txt

Robots Exclusion Standard data for itzine.ru

Resource Scan

Scan Details

Site Domain itzine.ru
Base Domain itzine.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-01T19:20:44+00:00
Next Scan 2024-11-08T19:20:44+00:00

Last Successful Scan

Scanned2024-10-24T11:24:14+00:00
URL https://itzine.ru/robots.txt
Domain IPs 2a01:4f8:c012:9085::1, 65.21.183.89
Response IP 65.21.183.89
Found Yes
Hash ee41add111e416694296bf4b4d01d1d143df7c5c4ee53e0d51f36cd59ffe9778
SimHash 6c88cae19a3a

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow *?nw
Disallow *?amp*
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow /goto/*
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-includes/js/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.webp
Allow */amp*
Allow /feed/
Allow /feed/turbo/
Allow /yandex/turbo/
Allow /yandex/news/
Allow /yandex/
Allow /?yandex_feed=news
Allow /sitemap_index.xml
Allow /post-sitemap*.xml
Allow /post-tag*.xml
Allow /page-sitemap*.xml
Allow /category-sitemap*.xml
Allow /sitemap-news.xml
Allow /yandex/news2
Allow /feed/zen/
Allow /advertisment
Allow /job
Allow /about
Allow /contacts
Allow /news
Allow /reviews
Allow /games
Allow /soft
Allow /smthelse
Allow /tag
Allow /wp-content/uploads/*
Allow /iphone-11
Allow /medals
Allow /yandex-reviews
Allow /gdpr
Allow /$
Allow /?$

yandex
yandexnews

Rule Path
Allow *
Allow /feed/
Allow */?feed
Allow /yandex/news2
Allow /feed/zen/

zen_bot

Rule Path
Disallow /
Allow /yandex/news2
Allow /feed/zen/

Other Records

Field Value
sitemap https://itzine.ru/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.