maple.ru
robots.txt

Robots Exclusion Standard data for maple.ru

Resource Scan

Scan Details

Site Domain maple.ru
Base Domain maple.ru
Scan Status Ok
Last Scan2024-09-25T14:20:40+00:00
Next Scan 2024-10-25T14:20:40+00:00

Last Scan

Scanned2024-09-25T14:20:40+00:00
URL https://maple.ru/robots.txt
Domain IPs 89.253.228.207
Response IP 89.253.228.207
Found Yes
Hash 36a3bfea6fb1d4c0fa027b667bec67acfa79198580f9e09b3814a4dd1a6f9eb4
SimHash 4f489b331421

Groups

*

Rule Path
Allow /search/map.php
Allow /
Allow /shop/
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/panel/
Disallow */index.php
Disallow /bitrix/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*PAGEN
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /register
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /login
Disallow /*logout%3D
Disallow /auth
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /personal/
Disallow /shop/cat/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Allow /
Disallow /auth
Disallow /bitrix
Disallow /personal
Disallow /login
Disallow /search

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandexmedia

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandexnews

Rule Path
Allow /about/news

Other Records

Field Value
crawl-delay 10

yandexmetrika

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandexmarket

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /
Disallow /auth
Disallow /bitrix
Disallow /search
Disallow /personal
Disallow /login

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /about/news

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Allow /about/news/
Allow /shop/
Allow /schools
Allow /service

Other Records

Field Value
crawl-delay 10

googlebot-mobile

Rule Path
Allow /shop/*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://maple.ru/sitemap.xml
sitemap https://www.maple.ru/shop/sitemap.xml
sitemap https://www.maple.ru/sitemap.xml
sitemap https://maple.ru/shop/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.