pogoda.unian.ua
robots.txt

Robots Exclusion Standard data for pogoda.unian.ua

Resource Scan

Scan Details

Site Domain pogoda.unian.ua
Base Domain unian.ua
Scan Status Ok
Last Scan2024-11-03T09:33:58+00:00
Next Scan 2024-12-03T09:33:58+00:00

Last Scan

Scanned2024-11-03T09:33:58+00:00
URL https://pogoda.unian.ua/robots.txt
Domain IPs 195.137.240.103, 195.137.240.83
Response IP 195.137.240.83
Found Yes
Hash d48a535cf12181812322b726e6ed08bf9b62f7b2ebf9b1e960e452993e2acdef
SimHash 781ccbc3b61f

Groups

*

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow /comments/
Disallow /search/
Disallow /content/
Disallow /profile/
Disallow /redirect/
Disallow /widget/
Disallow /m/comments/
Disallow /m/search/
Disallow /m/content/
Disallow /m/profile/
Disallow /m/redirect/
Disallow /m/widget/
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /m/?_ga
Disallow /?desktop
Disallow /m/?desktop
Disallow /?device_view
Disallow /m/?device_view
Disallow /?desktop_pogoda
Disallow /m/?desktop_pogoda
Disallow /?news_date
Disallow /m/?news_date
Disallow /?can_infinite_scroll
Disallow /m/?can_infinite_scroll

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments/
Disallow /search/
Disallow /profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments/
Disallow /search/
Disallow /profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Allow /*?page=

Other Records

Field Value
sitemap https://pogoda.unian.ua/sitemap.xml