compmaster.az
robots.txt

Robots Exclusion Standard data for compmaster.az

Resource Scan

Scan Details

Site Domain compmaster.az
Base Domain compmaster.az
Scan Status Ok
Last Scan2024-09-21T12:05:57+00:00
Next Scan 2024-10-21T12:05:57+00:00

Last Scan

Scanned2024-09-21T12:05:57+00:00
URL https://compmaster.az/robots.txt
Domain IPs 89.253.220.95
Response IP 89.253.220.95
Found Yes
Hash daff7b439c97bacd32b954bfdb49e820e741593ab0f81fbdb217d529d4d3e986
SimHash 46519f1721b5

Groups

*

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there
Disallow */index.php -
Disallow /bitrix/ -
Disallow /*show_include_exec_time%3D -
Disallow /*show_page_exec_time%3D -
Disallow /*show_sql_stat%3D -
Disallow /*bitrix_include_areas%3D -
Disallow /*clear_cache%3D -
Disallow /*clear_cache_session%3D -
Disallow /*ADD_TO_COMPARE_LIST -
Disallow /*ORDER_BY -
Disallow /*PAGEN -
Disallow /*?print= -
Disallow /*%26print%3D -
Disallow /*print_course%3D -
Disallow /*?action= -
Disallow /*%26action%3D -
Disallow /*register%3D -
Disallow /*forgot_password%3D -
Disallow /*change_password%3D -
Disallow /*login%3D -
Disallow /*logout%3D -
Disallow /*auth%3D -
Disallow /*backurl%3D -
Disallow /*back_url%3D -
Disallow /*BACKURL%3D -
Disallow /*BACK_URL%3D -
Disallow /*back_url_admin%3D -
Disallow /*?utm_source= -

yandex

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexbot

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexmedia

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandeximages

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexblogs

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexnews

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexmetrika

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

yandexmarket

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

googlebot

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

googlebot-news

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

googlebot-image

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

googlebot-video

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

googlebot-mobile

Rule Path Comment
Disallow empty Disallow instruction SHOULD be there

Other Records

Field Value
sitemap http://compmaster.az/var/www/ph179426/data/www/compmaster.az/sitemap.xml
sitemap http://compmaster.az/sitemap.xml

Warnings

  • `host` is not a known field.