tele.ru
robots.txt

Robots Exclusion Standard data for tele.ru

Resource Scan

Scan Details

Site Domain tele.ru
Base Domain tele.ru
Scan Status Ok
Last Scan2024-09-19T06:38:36+00:00
Next Scan 2024-09-26T06:38:36+00:00

Last Scan

Scanned2024-09-19T06:38:36+00:00
URL http://tele.ru/robots.txt
Domain IPs 5.188.158.75
Response IP 5.188.158.75
Found Yes
Hash e097760f7e9eff5250b145c0d822c754e93e40652d7592e9d207b0f517217b21
SimHash 20b499730238

Groups

yandexnews

Rule Path
Allow /rss/yandexnews/

*

Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow */wlwmanifest.xml -
Disallow /xmlrpc.php -
Disallow *utm*%3D -
Disallow *openstat%3D -
Disallow /readme.html Çàêðûâàåì áåñïîëåçíûé ìàíóàë ïî óñòàíîâêå WordPress (ëåæèò â êîðíå)
Disallow *?replytocom -
Allow */uploads -

mail.ru_bot

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Allow */feed
Allow */rss
Allow */feed/zen/
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow /chitayte*
Disallow */trackback
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow */*feed
Allow */rss
Allow */feed/zen/
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.tele.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.