savoltj.com
robots.txt
Robots Exclusion Standard data for savoltj.com
Resource Scan
Scan Details
Site Domain | savoltj.com |
Base Domain | savoltj.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-17T01:20:07+00:00 |
Next Scan | 2024-06-16T01:20:07+00:00 |
Last Successful Scan
Scanned | 2024-03-26T00:38:00+00:00 |
URL | https://savoltj.com/robots.txt |
Domain IPs | 104.21.26.56, 172.67.135.143, 2606:4700:3033::6815:1a38, 2606:4700:3035::ac43:878f |
Response IP | 104.21.26.56 |
Found | Yes |
Hash | 877421dab4ef62952f1f8a9a07a7f92f5c478d10c564b69ab903944f2ddde5b6 |
SimHash | 05509172c3bc |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /wp-admin | - |
Disallow | /trackback | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | /xmlrpc.php | - |
Disallow | *utm%3D | - |
Disallow | *openstat%3D | - |
Disallow | /readme.html | ÐакÑÑваем беÑполезнÑй манÑал по ÑÑÑановке WordPress (Ð»ÐµÐ¶Ð¸Ñ Ð² коÑне) |
Disallow | *?replytocom | - |
Disallow | *?filter_by= | - |
Disallow | *?bbp_reply_to= | - |
Allow | */uploads | - |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Other Records
Field | Value |
---|---|
sitemap | https://savoltj.com/sitemap.xml |
sitemap | https://savoltj.com/sitemap_index.xml |
sitemap | https://savoltj.com/post-sitemap.xml |
sitemap | https://savoltj.com/page-sitemap.xml |
sitemap | https://savoltj.com/category-sitemap.xml |
sitemap | https://savoltj.com/post_tag-sitemap.xml |
Warnings
- `host` is not a known field.