kids-tube.ru
robots.txt

Robots Exclusion Standard data for kids-tube.ru

Resource Scan

Scan Details

Site Domain kids-tube.ru
Base Domain kids-tube.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T08:06:28+00:00
Next Scan 2024-12-18T08:06:28+00:00

Last Successful Scan

Scanned2022-11-06T19:45:48+00:00
URL https://kids-tube.ru/robots.txt
Response IP 172.67.210.194, 104.21.35.14
Found Yes
Hash 202f542134e7e270427975dbd1b0bfc652c5f03e61cc4090357cef99c1b83166
SimHash 89744cd2d3d3

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*.php$
Disallow /*.cmt$
Disallow /*.inc$
Disallow /*.log$
Disallow /admin
Disallow /about.html
Disallow /search.html

*

Rule Path
Disallow /*.js$
Disallow /*.php$
Disallow /*.cmt$
Disallow /*.inc$
Disallow /*.log$
Disallow /v/
Disallow /list/
Disallow /admin
Disallow /about.html
Disallow /search.html

Warnings

  • `host` is not a known field.