adobe-reader-x.ru
robots.txt

Robots Exclusion Standard data for adobe-reader-x.ru

Resource Scan

Scan Details

Site Domain adobe-reader-x.ru
Base Domain adobe-reader-x.ru
Scan Status Ok
Last Scan2024-08-30T14:49:52+00:00
Next Scan 2024-09-29T14:49:52+00:00

Last Scan

Scanned2024-08-30T14:49:52+00:00
URL http://adobe-reader-x.ru/robots.txt
Domain IPs 81.177.141.93
Response IP 81.177.141.93
Found Yes
Hash 0821da3fd1d7bf12abe1a024d7be9faa245dea456f098d847161f3624f504ec9
SimHash 6a5ed4e0ca8a

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-cron.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /webstat/
Disallow /feed/
Disallow /tag/
Disallow /wp-json/
Disallow /search/
Disallow /goto/
Disallow *.html/*
Disallow */sphinx/*
Disallow */*.js*
Disallow /daos/
Disallow */?p*
Disallow */?s*

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

setlinks bot 2.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks bot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

vkshare

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 998111

mlbot

Rule Path
Disallow /downloads/

msie

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 600

yandexbot3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

yandexbot/3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

twitterbot/1.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitterbot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitter

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

riddler

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot/bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10000

Other Records

Field Value
sitemap http://adobe-reader-x.ru/sitemap.xml.gz
sitemap http://adobe-reader-x.ru/sitemap.xml

Warnings

  • `host` is not a known field.
  • `request-rate` is not a known field.