avatarko.ru
robots.txt

Robots Exclusion Standard data for avatarko.ru

Resource Scan

Scan Details

Site Domain avatarko.ru
Base Domain avatarko.ru
Scan Status Ok
Last Scan2025-11-27T00:33:00+00:00
Next Scan 2025-12-04T00:33:00+00:00

Last Scan

Scanned2025-11-27T00:33:00+00:00
URL https://avatarko.ru/robots.txt
Domain IPs 104.21.60.210, 172.67.201.128, 2606:4700:3033::6815:3cd2, 2606:4700:3034::ac43:c980
Response IP 104.21.60.210
Found Yes
Hash 03afd63af5f3ddcca1988f5b9354dbea31a1f0ce5ac11d0f75cf74fa59822cef
SimHash c21c9460c7f1

Groups

ahrefsbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /auth/

Warnings

  • `host` is not a known field.