sport.unian.ua
robots.txt

Robots Exclusion Standard data for sport.unian.ua

Resource Scan

Scan Details

Site Domain sport.unian.ua
Base Domain unian.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-02T07:52:42+00:00
Next Scan 2024-12-31T07:52:42+00:00

Last Successful Scan

Scanned2023-06-04T09:17:00+00:00
URL https://sport.unian.ua/robots.txt
Domain IPs 104.18.30.169, 104.18.31.169
Response IP 104.18.31.169
Found Yes
Hash 11e2fa7a4c061a105c0af4d836ff4758623deb60e910be8ed7f5c9d2df43bb59
SimHash 781dcac3b21f

Groups

*

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow /comments/
Disallow /search/
Disallow /content/
Disallow /profile/
Disallow /redirect/
Disallow /pogoda/widget/
Disallow /m/comments/
Disallow /m/search/
Disallow /m/content/
Disallow /m/profile/
Disallow /m/redirect/
Disallow /m/pogoda/widget/
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /m/?_ga
Disallow /?desktop
Disallow /m/?desktop
Disallow /?device_view
Disallow /m/?device_view
Disallow /?desktop_pogoda
Disallow /m/?desktop_pogoda
Disallow /?news_date
Disallow /m/?news_date
Disallow /?can_infinite_scroll
Disallow /m/?can_infinite_scroll

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments/
Disallow /search/
Disallow /profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /comments/
Disallow /search/
Disallow /profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Allow /*?page=

Other Records

Field Value
sitemap https://sport.unian.ua/sitemap.xml
sitemap https://sport.unian.ua/sitemaps/sitemaps/sitemap.rubrics.all_rubrics.xml
sitemap https://sport.unian.ua/sitemap_google.last.news.xml
sitemap https://sport.unian.ua/sitemap.last.news.xml