Log In Sign Up

newsplan.ru
robots.txt

Robots Exclusion Standard data for newsplan.ru

Resource Scan

Scan Details

Site Domain newsplan.ru
Base Domain newsplan.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-21T21:59:52+00:00
Next Scan 2024-12-20T21:59:52+00:00

Last Successful Scan

Scanned2023-05-25T13:28:42+00:00
URL http://newsplan.ru/robots.txt
Redirect http://www.newsplan.ru/robots.txt
Redirect Domain www.newsplan.ru
Redirect Base newsplan.ru
Domain IPs 185.201.54.28
Redirect IPs 185.201.54.28
Response IP 185.201.54.28
Found Yes
Hash 25dde8b1a040afe5b1dd324680b994d87c85f159228dfbe9d9f400be532815f8
SimHash 4900ca4263b1

Groups

yandex

Rule Path
Allow /*area%3Drss*
Allow /journal/yandex_rss/all/
Disallow /cache/static_fragment/
Disallow /*mode%3Dprint$
Disallow /*area%3D
Disallow /*.html?add

*

Rule Path
Allow /*area%3Drss*
Disallow /cache/static_fragment/
Disallow /*mode%3Dprint$
Disallow /*area%3D
Disallow /*.html?add
Back to top

Other Records

Field Value
sitemap http://www.newsplan.ru/sitemap_index.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top