shashlick.ru
robots.txt

Robots Exclusion Standard data for shashlick.ru

Resource Scan

Scan Details

Site Domain shashlick.ru
Base Domain shashlick.ru
Scan Status Ok
Last Scan2025-12-19T22:43:30+00:00
Next Scan 2025-12-26T22:43:30+00:00

Last Scan

Scanned2025-12-19T22:43:30+00:00
URL https://shashlick.ru/robots.txt
Domain IPs 91.106.202.20
Response IP 91.106.202.20
Found Yes
Hash d69b13d1940edb61bdd4582649db1dee9916f2035e649b586af501c79efba6cd
SimHash ef711d740630

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback/
Disallow *?*
Disallow */comment
Disallow */attachment/*
Disallow /author/
Disallow */category/*
Disallow */print/
Disallow */page/
Disallow *possible__unsafe__site*
Disallow *.html/
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*
Allow /wp-content/themes/*?ver*
Allow /wp-content/themes/*/img/
Allow /wp-includes/js/*?ver=

Other Records

Field Value
crawl-delay 5

wprocketbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://shashlick.ru/sitemap.xml

Warnings

  • `host` is not a known field.