lite.informator.ua
robots.txt

Robots Exclusion Standard data for lite.informator.ua

Resource Scan

Scan Details

Site Domain lite.informator.ua
Base Domain informator.ua
Scan Status Ok
Last Scan2024-11-11T12:13:30+00:00
Next Scan 2024-11-25T12:13:30+00:00

Last Scan

Scanned2024-11-11T12:13:30+00:00
URL https://lite.informator.ua/robots.txt
Domain IPs 51.195.190.221, 51.83.220.51
Response IP 51.83.220.51
Found Yes
Hash b99696d25ccd641ae43225d19b38176a035a7d90c21ffb8baeaea33dcc4c750e
SimHash 481d83c2e61f

Groups

*

Rule Path
Allow /
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow /comments*
Disallow /search
Disallow /content/
Disallow /profile/
Disallow /redirect/
Disallow */undefined
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /m/?_ga

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search
Disallow /profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search/
Disallow /profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js