dp.ru
robots.txt

Robots Exclusion Standard data for dp.ru

Resource Scan

Scan Details

Site Domain dp.ru
Base Domain dp.ru
Scan Status Ok
Last Scan2024-06-05T01:20:01+00:00
Next Scan 2024-06-12T01:20:01+00:00

Last Scan

Scanned2024-06-05T01:20:01+00:00
URL https://dp.ru/robots.txt
Redirect https://www.dp.ru/robots.txt
Redirect Domain www.dp.ru
Redirect Base dp.ru
Domain IPs 185.178.208.14
Redirect IPs 185.178.208.14
Response IP 185.178.208.14
Found Yes
Hash e818f413f1252976fab6893b35507eeb3462e5212fc23c505ce3cff8910d4c2a
SimHash 4d4095c5d591

Groups

*

Rule Path
Disallow /api/amp/
Disallow /article-in-rubric-preview

yandex

Rule Path
Disallow /article-in-rubric-preview
Disallow /api/amp/

googlebot

Rule Path
Disallow /article-in-rubric-preview
Allow /api/amp/

Other Records

Field Value
sitemap https://www.dp.ru/sitemap-index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.