savoltj.com
robots.txt

Robots Exclusion Standard data for savoltj.com

Resource Scan

Scan Details

Site Domain savoltj.com
Base Domain savoltj.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T01:20:07+00:00
Next Scan 2024-06-16T01:20:07+00:00

Last Successful Scan

Scanned2024-03-26T00:38:00+00:00
URL https://savoltj.com/robots.txt
Domain IPs 104.21.26.56, 172.67.135.143, 2606:4700:3033::6815:1a38, 2606:4700:3035::ac43:878f
Response IP 104.21.26.56
Found Yes
Hash 877421dab4ef62952f1f8a9a07a7f92f5c478d10c564b69ab903944f2ddde5b6
SimHash 05509172c3bc

Groups

*

Rule Path Comment
Disallow /cgi-bin -
Disallow /wp-admin -
Disallow /trackback -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /readme.html Закрываем бесполезный мануал по установке WordPress (лежит в корне)
Disallow *?replytocom -
Disallow *?filter_by= -
Disallow *?bbp_reply_to= -
Allow */uploads -

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://savoltj.com/sitemap.xml
sitemap https://savoltj.com/sitemap_index.xml
sitemap https://savoltj.com/post-sitemap.xml
sitemap https://savoltj.com/page-sitemap.xml
sitemap https://savoltj.com/category-sitemap.xml
sitemap https://savoltj.com/post_tag-sitemap.xml

Warnings

  • `host` is not a known field.