Log In Sign Up

vokrug.tv
robots.txt

Robots Exclusion Standard data for vokrug.tv

Resource Scan

Scan Details

Site Domain vokrug.tv
Base Domain vokrug.tv
Scan Status Ok
Last Scan2024-04-27T00:19:47+00:00
Next Scan 2024-05-04T00:19:47+00:00

Last Scan

Scanned2024-04-27T00:19:47+00:00
URL https://vokrug.tv/robots.txt
Domain IPs 80.66.90.75
Response IP 80.66.90.75
Found Yes
Hash 6d6c9f453371982e8dd287d61bca82315e727d963405f94c2ab868f361683c71
SimHash ed504ac3e3b9

Groups

yandex

Rule Path
Disallow /user/
Disallow /search/
Disallow /message/
Disallow /tag/
Disallow /link/
Disallow /TvGridXml/
Disallow /comments/
Disallow /amp/
Disallow /product/vote/

*

Rule Path
Disallow /user/
Disallow /search/
Disallow /message/
Disallow /tag/
Disallow /link/
Disallow /TvGridXml/
Disallow /comments/
Disallow /amp/person/
Disallow /product/vote/

mail.ru

Rule Path
Disallow /user/
Disallow /search/
Disallow /message/
Disallow /tag/
Disallow /link/
Disallow /TvGridXml/
Disallow /comments/
Disallow /amp/person/
Disallow /product/vote/

Other Records

Field Value
crawl-delay 2
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top