doklad-na-temu.ru
robots.txt

Robots Exclusion Standard data for doklad-na-temu.ru

Resource Scan

Scan Details

Site Domain doklad-na-temu.ru
Base Domain doklad-na-temu.ru
Scan Status Ok
Last Scan2024-11-08T19:17:22+00:00
Next Scan 2024-11-15T19:17:22+00:00

Last Scan

Scanned2024-11-08T19:17:22+00:00
URL https://doklad-na-temu.ru/robots.txt
Domain IPs 87.236.16.235
Response IP 87.236.16.235
Found Yes
Hash 47977eabd1930e4fe2f57f5886fcd12f8989dfe101c317945d8c9929539ffa93
SimHash 4b60dff746d4

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /search
Disallow */trackback/
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow */page/*
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow /author
Disallow /category
Disallow /2013
Disallow /2014
Disallow /2015
Disallow /2016
Disallow /2017
Disallow /*?*
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 120

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /search
Disallow */trackback/
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow */page/*
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow /author
Disallow /category
Disallow /2013
Disallow /2014
Disallow /2015
Disallow /2016
Disallow /2017
Disallow /*?*
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /search
Disallow */trackback/
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow */page/*
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow /author
Disallow /category
Disallow /*?*
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://doklad-na-temu.ru/sitemap.xml

Warnings

  • `host` is not a known field.