urveda.ru
robots.txt

Robots Exclusion Standard data for urveda.ru

Resource Scan

Scan Details

Site Domain urveda.ru
Base Domain urveda.ru
Scan Status Ok
Last Scan2024-09-25T03:14:49+00:00
Next Scan 2024-10-02T03:14:49+00:00

Last Scan

Scanned2024-09-25T03:14:49+00:00
URL https://urveda.ru/robots.txt
Domain IPs 91.206.14.160
Response IP 91.206.14.160
Found Yes
Hash c78c9194e2772c39d73893700f16e8e0fbb7faa2d8aea37e2fb1775f0c424bfe
SimHash 4951dfa7065c

Groups

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /
Allow *favicon*

yandexmedia

Rule Path
Disallow /
Allow *favicon*

tineye-bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /t
Disallow /t/*/
Disallow /tg
Disallow /tg/*/
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js
Disallow /search
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow /wp-content/uploads/
Disallow */page/*

Other Records

Field Value
sitemap https://urveda.ru/sitemap.xml

Comments

  • global

Warnings

  • `host` is not a known field.