ahml.ru
robots.txt

Robots Exclusion Standard data for ahml.ru

Resource Scan

Scan Details

Site Domain ahml.ru
Base Domain ahml.ru
Scan Status Ok
Last Scan2024-09-07T20:05:07+00:00
Next Scan 2024-10-07T20:05:07+00:00

Last Scan

Scanned2024-09-07T20:05:07+00:00
URL https://ahml.ru/robots.txt
Redirect https://xn--d1aqf.xn--p1ai/robots.txt
Redirect Domain дом.рф
Redirect Base дом.рф
Domain IPs 185.169.155.189
Redirect IPs 185.169.155.189
Response IP 185.169.155.189
Found Yes
Hash e273528635ca15999e87f3b5fc7676badda3498adf68d1e771d2c6b39aa689f4
SimHash 4803ce9bc783

Groups

*

Rule Path
Disallow /_ntnc%3D
Disallow /k50id%3D
Disallow /*_openstat
Disallow /*gclid%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*utm_campaign%3D
Disallow /*utm_term%3D
Disallow /*?from=
Disallow /*utm_content%3D
Disallow /?test=yes
Disallow /?test=test
Disallow /test/
Disallow /4-7th-html/
Disallow /*test
Disallow /?p=
Disallow /bitrix/admin/
Disallow /admin/
Disallow /bitrix/
Disallow /backurl%3D
Disallow /back_url%3D
Disallow /search/
Disallow /upload/
Disallow /private/
Disallow /welcome/
Disallow /welcome-office/
Disallow /local/ajax/
Disallow /ajax/
Disallow /api/
Disallow /investors/information-reveal/
Disallow /*?*
Disallow /static/*.html

Other Records

Field Value
crawl-delay 30

yandex

Rule Path
Disallow /_ntnc%3D
Disallow /k50id%3D
Disallow /*_openstat
Disallow /*gclid%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*utm_campaign%3D
Disallow /*utm_term%3D
Disallow /*?from=
Disallow /*utm_content%3D
Disallow /?test=yes
Disallow /?test=test
Disallow /test/
Disallow /4-7th-html/
Disallow /*test
Disallow /?p=
Disallow /bitrix/admin/
Disallow /admin/
Disallow /bitrix/
Disallow /backurl%3D
Disallow /back_url%3D
Disallow /search/
Disallow /upload/
Disallow /private/
Disallow /welcome/
Disallow /welcome-office/
Disallow /local/ajax/
Disallow /ajax/
Disallow /api/
Disallow /investors/information-reveal/
Disallow /*?*
Disallow /static/*.html
Disallow /en/*/
Allow /en/

Other Records

Field Value
crawl-delay 30

ia_archiver

Rule Path
Disallow /

yandexnews

Rule Path
Allow /upload/yandex_rss_1.xml

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://xn--d1aqf.xn--p1ai/sitemaps/sitemap.xml

Warnings

  • `host` is not a known field.