fkmg.ru
robots.txt

Robots Exclusion Standard data for fkmg.ru

Resource Scan

Scan Details

Site Domain fkmg.ru
Base Domain fkmg.ru
Scan Status Ok
Last Scan2024-10-15T17:20:02+00:00
Next Scan 2024-11-14T17:20:02+00:00

Last Scan

Scanned2024-10-15T17:20:02+00:00
URL https://fkmg.ru/robots.txt
Domain IPs 87.236.16.235
Response IP 87.236.16.235
Found Yes
Hash 1617daa1ff51123bdfdb6f2d20e92095c8ff742509fc6d32ea5bab5733379316
SimHash b5038845e597

Groups

*

Rule Path
Disallow /catalog/new/
Disallow /catalog/sale/
Disallow /auth*
Disallow /basket*
Disallow /order*
Disallow /personal/
Disallow /search/
Disallow /test/
Disallow /ajax/
Disallow /*index.php*
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /bitrix/admin/
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*print*
Disallow /*action*
Disallow /*register%3D
Disallow /*password*
Disallow /*login%3D
Disallow /*type%3D
Disallow /*sort%3D
Disallow /*order%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?arrFilter*

Other Records

Field Value
crawl-delay 20

Warnings

  • `host` is not a known field.