kiev.informator.ua
robots.txt

Robots Exclusion Standard data for kiev.informator.ua

Resource Scan

Scan Details

Site Domain kiev.informator.ua
Base Domain informator.ua
Scan Status Ok
Last Scan2024-09-16T23:37:44+00:00
Next Scan 2024-10-16T23:37:44+00:00

Last Scan

Scanned2024-09-16T23:37:44+00:00
URL https://kiev.informator.ua/robots.txt
Domain IPs 51.15.27.33, 51.195.190.221
Response IP 51.195.190.221
Found Yes
Hash b99696d25ccd641ae43225d19b38176a035a7d90c21ffb8baeaea33dcc4c750e
SimHash 481d83c2e61f

Groups

*

Rule Path
Allow /
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow /comments*
Disallow /search
Disallow /content/
Disallow /profile/
Disallow /redirect/
Disallow */undefined
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /m/?_ga

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search
Disallow /profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search/
Disallow /profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js