ya-roditel.ru
robots.txt

Robots Exclusion Standard data for ya-roditel.ru

Resource Scan

Scan Details

Site Domain ya-roditel.ru
Base Domain ya-roditel.ru
Scan Status Ok
Last Scan2024-10-09T06:57:04+00:00
Next Scan 2024-11-08T06:57:04+00:00

Last Scan

Scanned2024-10-09T06:57:04+00:00
URL https://ya-roditel.ru/robots.txt
Domain IPs 212.41.23.162
Response IP 212.41.23.162
Found Yes
Hash dff66720824bf44fc95f379fd91a39e325d14b6894b0936161dda23fc6f2ecfa
SimHash 58ce98752e33

Groups

*

Rule Path
Disallow *tag*
Disallow /*search
Disallow /*users
Disallow /rss/
Disallow /*print
Disallow /*admin
Disallow /*login
Disallow /reminder
Disallow /mutogen
Disallow /*password
Disallow /city2011/sun.swf
Disallow /upload/player
Disallow /*year%3D
Disallow /*month%3D
Disallow /*photo%3D
Disallow /contests-promotions/city-child/city_child.php
Disallow /contests-promotions/city-child/city_child_all.php
Disallow /contests-promotions/city-orphans/city.php
Disallow /contests-promotions/city-orphans/all.php
Disallow /contests-promotions/semya-goda-2018/
Disallow */join/personal/people-list/*
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow *%3F%3F%3F%3F%3F%3F%3F%3F%3F_%3F%3F%3F%3F%3F%3F%3F*
Disallow /ajax/
Disallow *from%3D*
Disallow *3%3D*
Disallow *index.php*
Disallow *file%3D*
Disallow *BASE-FILTER*
Disallow *GEO_FILTER*
Disallow /parents/helpline*
Disallow *sphrase_id%3D*
Disallow *photokonkurs/cont/?*
Disallow *id%3D-1*
Disallow *ELEMENT_ID%3D*
Disallow *?idne*
Disallow *?register=*
Disallow *?rel=*
Disallow /forum/
Disallow /forum/user/
Allow /professionals/research/
Allow /parents/helpline/
Disallow *amp%3D*
Disallow *amp%3B*
Disallow *SECTION_CODE%3D*
Disallow *index*
Disallow /search/
Disallow *?amp*
Disallow /?*

yandex

Rule Path
Disallow *tag*
Disallow /*search
Disallow /*users
Disallow /rss/
Disallow /*print
Disallow /*admin
Disallow /*login
Disallow /reminder
Disallow /mutogen
Disallow /*password
Disallow /city2011/sun.swf
Disallow /upload/player
Disallow /*year%3D
Disallow /*month%3D
Disallow /*photo%3D
Disallow /contests-promotions/city-child/city_child.php
Disallow /contests-promotions/city-child/city_child_all.php
Disallow /contests-promotions/city-orphans/city.php
Disallow /contests-promotions/city-orphans/all.php
Disallow /contests-promotions/semya-goda-2018/
Disallow */join/personal/people-list/*
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow *%3F%3F%3F%3F%3F%3F%3F%3F%3F_%3F%3F%3F%3F%3F%3F%3F*
Disallow /ajax/
Disallow *from%3D*
Disallow *3%3D*
Disallow *index.php*
Disallow *file%3D*
Disallow *BASE-FILTER*
Disallow *GEO_FILTER*
Disallow /parents/helpline*
Disallow *sphrase_id%3D*
Disallow *photokonkurs/cont/?*
Disallow *id%3D-1*
Disallow *ELEMENT_ID%3D*
Disallow *?idne*
Disallow *?register=*
Disallow *?rel=*
Disallow /forum/
Disallow /forum/user/
Allow /professionals/research/
Allow /parents/helpline/
Disallow *amp%3D*
Disallow *amp%3B*
Disallow *SECTION_CODE%3D*
Disallow *index*
Disallow /search/
Disallow *?amp*
Disallow /?*

alligator

Rule Path
Disallow /

avantgo

Rule Path
Disallow /

badass

Rule Path
Disallow /

diibot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

flashget

Rule Path
Disallow /

flickbot

Rule Path
Disallow /

frontpage

Rule Path
Disallow /

getright

Rule Path
Disallow /

grub

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

httplib

Rule Path
Disallow /

httrack

Rule Path
Disallow /

java

Rule Path
Disallow /

java/1.4.1_01

Rule Path
Disallow /

java/1.4.1_02

Rule Path
Disallow /

java/1.4.1_04

Rule Path
Disallow /

java/1.4.2

Rule Path
Disallow /

java/1.4.2_01

Rule Path
Disallow /

java/1.4.2_03

Rule Path
Disallow /

java/1.4.2_04

Rule Path
Disallow /

java/1.4.2_05

Rule Path
Disallow /

java/1.4.2_06

Rule Path
Disallow /

java/1.4.2_08

Rule Path
Disallow /

java/1.4.2_09

Rule Path
Disallow /

java/1.4.2_10

Rule Path
Disallow /

java/1.5.0

Rule Path
Disallow /

java/1.5.0_01

Rule Path
Disallow /

java/1.5.0_02

Rule Path
Disallow /

java/1.5.0_03

Rule Path
Disallow /

java/1.5.0_04

Rule Path
Disallow /

java/1.5.0_05

Rule Path
Disallow /

java/1.5.0_06

Rule Path
Disallow /

java/1.6.0

Rule Path
Disallow /

java/1.6.0_01

Rule Path
Disallow /

java/1.6.0_02

Rule Path
Disallow /

java/1.6.0_03

Rule Path
Disallow /

java/1.6.0_04

Rule Path
Disallow /

java/1.6.0_05

Rule Path
Disallow /

java/1.6.0_06

Rule Path
Disallow /

java/1.6.0_07

Rule Path
Disallow /

java/1.6.0_10

Rule Path
Disallow /

java/1.6.0_11

Rule Path
Disallow /

java/1.6.0_12

Rule Path
Disallow /

java/1.6.0_13

Rule Path
Disallow /

java/1.6.0_14

Rule Path
Disallow /

java1.3.1_03

Rule Path
Disallow /

java1.4.0_01

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

lwp

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

lycra

Rule Path
Disallow /

naver

Rule Path
Disallow /

netants

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

msproxy

Rule Path
Disallow /

netspider

Rule Path
Disallow /

openbot

Rule Path
Disallow /

php

Rule Path
Disallow /

robot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

urlspiderpro

Rule Path
Disallow /

user-agent

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webemailextrac

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ya-roditel.ru/sitemap.xml
sitemap https://www.ya-roditel.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.