Log In Sign Up

sakhalife.ru
robots.txt

Robots Exclusion Standard data for sakhalife.ru

Resource Scan

Scan Details

Site Domain sakhalife.ru
Base Domain sakhalife.ru
Scan Status Ok
Last Scan2024-09-28T03:48:57+00:00
Next Scan 2024-10-05T03:48:57+00:00

Last Scan

Scanned2024-09-28T03:48:57+00:00
URL https://sakhalife.ru/robots.txt
Domain IPs 45.12.74.131
Response IP 45.12.74.131
Found Yes
Hash 1f1074ca4f85225ced533165af0291ac48419a2bd56d5cfa000fd25a6feb46a6
SimHash 21b0d9f2827a

Groups

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Allow */uploads

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *openstat%3D
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */rss
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Allow /sakhalife.ru/yandex/news/
Allow /sakhalife.ru/feed/turbo/
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://sakhalife.ru/sitemap.xml
sitemap https://sakhalife.ru/sitemap.xml.gz
Back to top

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.
Back to top