autolight.by
robots.txt

Robots Exclusion Standard data for autolight.by

Resource Scan

Scan Details

Site Domain autolight.by
Base Domain autolight.by
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-21T19:11:48+00:00
Next Scan 2024-07-05T19:11:48+00:00

Last Successful Scan

Scanned2024-05-14T19:11:06+00:00
URL https://autolight.by/robots.txt
Domain IPs 178.172.173.136
Response IP 178.172.173.136
Found Yes
Hash 9b676525f014438c5f2bac144b25596273676534cb8cd47117ee101ef4a942ef
SimHash 6ff199e243dd

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp*
Disallow /barcode*
Disallow /class/
Disallow /components/
Disallow /online/calculator/
Disallow /online/calculator/index.php
Disallow /online/quick/
Disallow /online/tracking/
Disallow /online/calc/
Disallow /upload/
Disallow /bitrix/
Disallow /ajax/
Disallow /js/
Disallow /online_services/
Disallow /auth/
Disallow *.pdf
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$
Disallow /download.php

yandexbot

Rule Path
Disallow /cgi-bin
Disallow /tmp
Disallow /barcode
Disallow /class
Disallow /components
Disallow /online/calculator
Disallow /online/calculator/index.php
Disallow /online/quick
Disallow /online/tracking
Disallow /online/calc
Disallow /upload
Disallow /bitrix
Disallow /ajax
Disallow /online_services
Disallow /auth
Disallow *.pdf
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

yandexmedia

Rule Path
Disallow *

yandeximages

Rule Path
Disallow *

yandexblogs

Rule Path
Disallow *

yandexnews

Rule Path
Disallow *

yandexmetrika
yandexmarket
googlebot

Rule Path
Disallow /online/calculator
Disallow /cgi-bin
Disallow /tmp
Disallow /barcode
Disallow /class
Disallow /components
Disallow /online/calculator
Disallow /online/calculator/index.php
Disallow /online/quick
Disallow /online/tracking
Disallow /online/calc
Disallow /upload
Disallow /bitrix
Disallow /ajax
Disallow /online_services
Disallow /auth
Disallow *.pdf
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

googlebot-news

Rule Path
Disallow /cgi-bin
Disallow /tmp
Disallow /barcode
Disallow /class
Disallow /components
Disallow /online/calculator
Disallow /online/calculator/index.php
Disallow /online/quick
Disallow /online/tracking
Disallow /online/calc
Disallow /upload
Disallow /bitrix
Disallow /ajax
Disallow /online_services
Disallow /auth
Disallow *.pdf
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

googlebot-image

Rule Path
Disallow *

googlebot-video

Rule Path
Disallow *

googlebot-mobile

Rule Path
Disallow /cgi-bin
Disallow /tmp
Disallow /barcode
Disallow /class
Disallow /components
Disallow /online/calculator
Disallow /online/calculator/index.php
Disallow /online/quick
Disallow /online/tracking
Disallow /online/calc
Disallow /upload
Disallow /bitrix
Disallow /ajax
Disallow /online_services
Disallow /auth
Disallow *.pdf
Disallow /*?
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

Warnings

  • `host` is not a known field.