agro-kyrgyzstan.com
robots.txt

Robots Exclusion Standard data for agro-kyrgyzstan.com

Resource Scan

Scan Details

Site Domain agro-kyrgyzstan.com
Base Domain agro-kyrgyzstan.com
Scan Status Ok
Last Scan2024-11-15T15:35:00+00:00
Next Scan 2024-11-22T15:35:00+00:00

Last Scan

Scanned2024-11-15T15:35:00+00:00
URL https://agro-kyrgyzstan.com/robots.txt
Domain IPs 176.111.63.167
Response IP 176.111.63.167
Found Yes
Hash 060bd6b00f816421dffa0caa6faba1aa02c4077b991748c245600f5ee95363e5
SimHash 0e4cd8e6d011

Groups

googlebot

Rule Path
Disallow /ru/trade/?
Disallow /ru/trade/tag-
Disallow /ru/settings/
Disallow /ru/office/
Disallow /files/
Disallow /cache/
Disallow /logs/
Disallow /templates/
Disallow /imgs/zzz/
Disallow /*?

mediapartners-google

Rule Path
Disallow /files/
Disallow /cache/
Disallow /imgs/zzz/
Disallow /templates/

yandex

Rule Path
Disallow /ru/trade/?
Disallow /ru/trade/tag-
Disallow /ru/settings/
Disallow /ru/office/
Disallow /files/
Disallow /cache/
Disallow /logs/
Disallow /templates/
Disallow /imgs/zzz/
Disallow /*?

yandexdirect

Rule Path
Disallow /files/
Disallow /cache/
Disallow /imgs/zzz/

slurp

Rule Path
Disallow /ru/trade/?
Disallow /ru/trade/tag-
Disallow /ru/settings/
Disallow /ru/office/
Disallow /ru/users/
Disallow /files/
Disallow /cache/
Disallow /logs/
Disallow /imgs/zzz/
Disallow /templates/
Disallow /*?

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /ru/trade/?
Disallow /ru/trade/tag-
Disallow /ru/settings/
Disallow /ru/office/
Disallow /ru/users/
Disallow /files/
Disallow /cache/
Disallow /logs/
Disallow /imgs/zzz/
Disallow /templates/
Disallow /*?

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.