admitsoft.ru
robots.txt

Robots Exclusion Standard data for admitsoft.ru

Resource Scan

Scan Details

Site Domain admitsoft.ru
Base Domain admitsoft.ru
Scan Status Ok
Last Scan2024-09-27T23:58:58+00:00
Next Scan 2024-10-04T23:58:58+00:00

Last Scan

Scanned2024-09-27T23:58:58+00:00
URL https://admitsoft.ru/robots.txt
Domain IPs 195.161.68.211
Response IP 195.161.68.211
Found Yes
Hash d4a842c5a09e3ad6557d746a6b77fbf0f8c16dcf2e4b57d76804aac8157e1110
SimHash 6a9afcf0c88a

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-cron.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /webstat/
Disallow /feed/
Disallow /tag/
Disallow /wp-json/
Disallow /search/
Disallow /goto/
Disallow *.html/*
Disallow */sphinx/*
Disallow */*.js*
Disallow /daos/
Disallow */?p*
Disallow */?s*

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

setlinks bot 2.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

setlinks bot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 99

vkshare

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 998111

mlbot

Rule Path
Disallow /downloads/

msie

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 600

yandexbot3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

yandexbot/3.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60

twitterbot/1.0

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitterbot

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

twitter

Rule Path
Disallow /downloads/

Other Records

Field Value
crawl-delay 60000

riddler

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msnbot/bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10000

Other Records

Field Value
sitemap https://admitsoft.ru/sitemap.xml.gz
sitemap https://admitsoft.ru/sitemap.xml

Warnings

  • `host` is not a known field.
  • `request-rate` is not a known field.