faq-teamviewer.ru
robots.txt

Robots Exclusion Standard data for faq-teamviewer.ru

Resource Scan

Scan Details

Site Domain faq-teamviewer.ru
Base Domain faq-teamviewer.ru
Scan Status Ok
Last Scan2024-09-25T08:19:59+00:00
Next Scan 2024-10-02T08:19:59+00:00

Last Scan

Scanned2024-09-25T08:19:59+00:00
URL http://faq-teamviewer.ru/robots.txt
Domain IPs 195.161.41.65
Response IP 195.161.41.65
Found Yes
Hash 8af4d98f9d8473a9d92baaaf5a118e0935557117236e1efb18cd0535bef5da04
SimHash 7a5edcf0ca88

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-cron.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /webstat/
Disallow /feed/
Disallow /tag/
Disallow /wp-json/
Disallow /search/
Disallow /goto/
Disallow *.html/*
Disallow */sphinx/*
Disallow */*.js*
Disallow /daos/
Disallow */?p*
Disallow */?s*

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

setlinks bot 2.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks bot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

vkshare

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 998111

mlbot

Rule Path
Disallow /downloads/

msie

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 600

yandexbot3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

yandexbot/3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

twitterbot/1.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitterbot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitter

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

riddler

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot/bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10000

Other Records

Field Value
sitemap http://faq-teamviewer.ru/sitemap.xml.gz
sitemap http://faq-teamviewer.ru/sitemap.xml

Warnings

  • `host` is not a known field.
  • `request-rate` is not a known field.