you-anime.ru
robots.txt

Robots Exclusion Standard data for you-anime.ru

Resource Scan

Scan Details

Site Domain you-anime.ru
Base Domain you-anime.ru
Scan Status Ok
Last Scan2024-11-15T07:00:19+00:00
Next Scan 2024-11-22T07:00:19+00:00

Last Scan

Scanned2024-11-15T07:00:19+00:00
URL https://you-anime.ru/robots.txt
Domain IPs 104.21.29.53, 172.67.171.95
Response IP 172.67.171.95
Found Yes
Hash 6a5fa602b82d819f5352648e07d1dd236a197a385ca3ea843b66ad17985ef70b
SimHash c6142f2aca93

Groups

*

Rule Path
Disallow /admin
Disallow /filter
Disallow /manga/filter
Disallow /random-anime
Disallow /random-manga
Disallow /search
Disallow /manga/search
Disallow /user
Disallow /rooms/

ahrefsbot
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
yahoo pipes 1.0
yahoo pipes 2.0

Rule Path
Disallow /

Warnings

  • `host` is not a known field.