fr.mos.ru
robots.txt

Robots Exclusion Standard data for fr.mos.ru

Resource Scan

Scan Details

Site Domain fr.mos.ru
Base Domain mos.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-02-15T19:29:14+00:00
Next Scan 2025-03-17T19:29:14+00:00

Last Successful Scan

Scanned2024-12-25T19:25:15+00:00
URL https://fr.mos.ru/robots.txt
Domain IPs 212.11.155.165, 212.11.155.166, 212.11.155.167
Response IP 212.11.155.166
Found Yes
Hash ddd5b52a5a7f70d6530f41197b5ec7c018c4dba2d87f731e202b8d395a582905
SimHash 44089c57c5b3

Groups

*

Rule Path
Disallow /bitrix/
Disallow /local/
Disallow /upload/
Disallow /auth/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*bitrix_*%3D
Disallow /404.php
Disallow /403.html
Disallow /404.html
Disallow /502.html
Disallow /503.html
Disallow /504.html

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://fr.mos.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.