Log In Sign Up

pensnews.ru
robots.txt

Robots Exclusion Standard data for pensnews.ru

Resource Scan

Scan Details

Site Domain pensnews.ru
Base Domain pensnews.ru
Scan Status Ok
Last Scan2024-10-05T13:46:29+00:00
Next Scan 2024-10-12T13:46:29+00:00

Last Scan

Scanned2024-10-05T13:46:29+00:00
URL https://pensnews.ru/robots.txt
Domain IPs 188.127.241.101
Response IP 188.127.241.101
Found Yes
Hash db60f536b92f9e5ed2c2cc180f92ea2c549b34a3adf42a88789266af7c05e87b
SimHash 4c11c847ed13

Groups

*

Rule Path
Disallow /search
Disallow /editor
Disallow /index.php
Disallow /share
Disallow /article/*?page=
Disallow /article/*/comments
Disallow /amp/*
Disallow *?

yandex

Rule Path
Disallow /search
Disallow /editor
Disallow /index.php
Disallow /share
Disallow /article/*?page=
Disallow /article/*/comments
Disallow /amp/*
Disallow *?
Back to top

Other Records

Field Value
sitemap https://pensnews.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top