informator.ua
robots.txt

Robots Exclusion Standard data for informator.ua

Resource Scan

Scan Details

Site Domain informator.ua
Base Domain informator.ua
Scan Status Ok
Last Scan2024-05-23T19:46:17+00:00
Next Scan 2024-05-30T19:46:17+00:00

Last Scan

Scanned2024-05-23T19:46:17+00:00
URL https://informator.ua/robots.txt
Domain IPs 51.15.20.236, 51.15.27.33
Response IP 51.15.20.236
Found Yes
Hash 3644ce82aeb38cda2d7d93c8146035356dd235221298bf6b32e22ea47a706dad
SimHash 481d8342e217

Groups

*

Rule Path
Allow /
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow /comments*
Disallow /search
Disallow /content/
Disallow /profile/
Disallow /redirect/
Disallow */undefined
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /m/?_ga

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search
Disallow /profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments*
Disallow /search/
Disallow /profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /