Log In Sign Up

semenasaltaiy.ru
robots.txt

Robots Exclusion Standard data for semenasaltaiy.ru

Resource Scan

Scan Details

Site Domain semenasaltaiy.ru
Base Domain semenasaltaiy.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-18T19:19:27+00:00
Next Scan 2025-07-17T19:19:27+00:00

Last Successful Scan

Scanned2024-06-23T19:17:02+00:00
URL https://semenasaltaiy.ru/robots.txt
Domain IPs 104.21.75.77, 172.67.217.116, 2606:4700:3036::6815:4b4d, 2606:4700:3037::ac43:d974
Response IP 172.67.217.116
Found Yes
Hash 24bfb8b6206846adacb3eb4725840b717217e7040037d22d20a3f879073eb97b
SimHash 015dd202a546

Groups

yandex

Rule Path
Disallow /

googlebot

Rule Path
Disallow /author
Disallow /cdn-cgi/
Disallow /privacy-policy/
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Allow */uploads
Allow *.js
Allow *.css
Allow *.png
Allow *.gif
Allow *.jpg

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://semenasaltaiy.ru/sitemap.xml
Back to top