thesis.od.ua
robots.txt

Robots Exclusion Standard data for thesis.od.ua

Resource Scan

Scan Details

Site Domain thesis.od.ua
Base Domain thesis.od.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-23T10:48:11+00:00
Next Scan 2026-03-23T10:48:11+00:00

Last Successful Scan

Scanned2025-05-04T18:59:56+00:00
URL https://thesis.od.ua/robots.txt
Domain IPs 185.68.16.85, 2a00:7a60:0:1055::1
Response IP 185.68.16.85
Found Yes
Hash a3c5bcdd55a26e6a07c633e0a0cf0180edea79b8afedfa2718b93fb6af3252f1
SimHash 206dd1738d39

Groups

googlebot

Rule Path Comment
Allow /*/*.js открываем js-скрипты внутри /wp- (/*/ - для приоритета)
Allow /*/*.css открываем css-файлы внутри /wp- (/*/ - для приоритета)
Allow /wp-*.png картинки в плагинаÑ
Allow /wp-*.jpg картинки в плагинаÑ
Allow /wp-*.jpeg картинки в плагинаÑ
Allow /wp-*.gif картинки в плагинаÑ
Allow /wp-admin/admin-ajax.php используется плагинами, чтобы не блокировать JS и CSS
Allow */uploads -
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow */wlwmanifest.xml -
Disallow /xmlrpc.php -
Disallow *utm*%3D -
Disallow *openstat%3D -

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

teoma

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

scooter

Rule Path
Disallow

yandex

Rule Path
Disallow

mail.ru

Rule Path
Disallow

stackrambler

Rule Path
Disallow

aport

Rule Path
Disallow

webalta

Rule Path
Disallow

Other Records

Field Value
sitemap http://www.thesis.od.ua/post-sitemap.xml

Warnings

  • 4 invalid lines.