kurs2015.ru
robots.txt

Robots Exclusion Standard data for kurs2015.ru

Resource Scan

Scan Details

Site Domain kurs2015.ru
Base Domain kurs2015.ru
Scan Status Ok
Last Scan2024-06-14T09:46:58+00:00
Next Scan 2024-06-21T09:46:58+00:00

Last Scan

Scanned2024-06-14T09:46:58+00:00
URL https://kurs2015.ru/robots.txt
Domain IPs 35.214.141.30
Response IP 35.214.141.30
Found Yes
Hash ce70803d1071c9f1478a9f030a425190ba951262b24a629b28df72ead4d06738
SimHash 65008ee08691

Groups

*

Rule Path
Allow /$
Allow /sitemap.xml
Disallow /content/
Disallow /?*
Disallow /1*
Disallow /2*
Disallow /3*
Disallow /4*
Disallow /5*
Disallow /6*
Disallow /7*
Disallow /8*
Disallow /9*
Disallow /0*
Disallow /test*
Disallow /*?*
Disallow /page*
Disallow /novosti*

yandex

Rule Path
Allow /file.rss

Other Records

Field Value
crawl-delay 0.1

Other Records

Field Value
sitemap https://kurs2015.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.