doskarvp.ru
robots.txt

Robots Exclusion Standard data for doskarvp.ru

Resource Scan

Scan Details

Site Domain doskarvp.ru
Base Domain doskarvp.ru
Scan Status Ok
Last Scan2026-03-05T11:02:23+00:00
Next Scan 2026-04-04T11:02:23+00:00

Last Scan

Scanned2026-03-05T11:02:23+00:00
URL https://doskarvp.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:31, 31.31.196.31
Response IP 31.31.196.31
Found Yes
Hash a954fc3185a51ac17de44a6ea7c054ed08c74904d0ff09024f8f7dba6e445c6e
SimHash 4918ccf3c790

Groups

*

Rule Path
Disallow /media/
Disallow /temp/
Disallow /templates/

Other Records

Field Value Comment
crawl-delay 40 задает таймаут в 40 секунд для всеÑ

Other Records

Field Value
sitemap https://doskarvp.ru/sitemap.xml

Warnings

  • 2 invalid lines.
  • `host` is not a known field.