pchelka-nn.ru
robots.txt

Robots Exclusion Standard data for pchelka-nn.ru

Resource Scan

Scan Details

Site Domain pchelka-nn.ru
Base Domain pchelka-nn.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-11T04:19:58+00:00
Next Scan 2025-01-09T04:19:58+00:00

Last Successful Scan

Scanned2023-11-24T04:16:41+00:00
URL https://pchelka-nn.ru/robots.txt
Domain IPs 104.21.62.150, 172.67.136.182, 2606:4700:3032::ac43:88b6, 2606:4700:3035::6815:3e96
Response IP 104.21.62.150
Found Yes
Hash ef4c480f56003b4807d968df52327c42f9d705d7084741e62933d0c8ac7de45f
SimHash 52464b72c739

Groups

*

Rule Path
Disallow /*index.php$
Disallow /bitrix/
Disallow /auth/
Disallow /personal/
Disallow /upload/
Disallow /search/
Disallow /materials/
Disallow /guestbook/
Disallow /order/
Disallow /otzyvy/
Disallow /question/
Disallow /reviews/
Disallow /*/search/
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*print%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*action*
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*print_course%3DY
Disallow /*COURSE_ID%3D
Disallow /*?COURSE_ID=
Disallow /*?PAGEN
Disallow /*PAGEN_1%3D
Disallow /*PAGEN_2%3D
Disallow /*PAGEN_3%3D
Disallow /*PAGEN_4%3D
Disallow /*PAGEN_5%3D
Disallow /*PAGEN_6%3D
Disallow /*PAGEN_7%3D
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*SHOWALL
Disallow /*show_all%3D
Disallow */index.php?*
Disallow /404
Disallow *?sort*
Disallow *?method*
Disallow *?option*
Disallow */filter/*
Disallow *?set_filter*
Disallow /*?*
Disallow /?alfaction*
Allow /bitrix/cache/css/s1/prokids_default/
Allow /bitrix/cache/css/s1/tmpl_main/*
Allow /bitrix/cache/js/s1/prokids_default/
Allow /bitrix/cache/js/s1/tmpl_main/*
Allow /bitrix/js/main/core/
Allow /bitrix/js/main/jquery/*
Allow /bitrix/templates/*.css
Allow /bitrix/templates/*.js
Allow /bitrix/templates/*.png
Allow /bitrix/templates/prokids_default/assets/fonts/font-awesome/
Allow /bitrix/templates/prokids_default/assets/fonts/ttf/*.ttf
Allow /bitrix/templates/prokids_default/assets/img/
Allow /bitrix/tools/conversion/*.php
Allow /question/js/*.js
Allow /upload/iblock/*.jpg
Allow /upload/iblock/*.jpeg
Allow /upload/iblock/*.JPG
Allow /upload/iblock/*.png
Allow /upload/resize_cache/iblock/*.jpeg

adsbot-googleâ

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aport

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

birubot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dataforseobotâ

Rule Path
Disallow /

deusu

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

docâ

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

fast

Rule Path
Disallow /

fetch

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

httrack

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

internetseer

Rule Path
Disallow /

israbot

Rule Path
Disallow /

java

Rule Path
Disallow /

js-kit

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

kmsearchbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linespider

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linkexchanger

Rule Path
Disallow /

linko

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

postrank

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

soup

Rule Path
Disallow /

spbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sweb

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

voyager

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websnake

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

yottosbot

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pchelka-nn.ru/sitemap.xml

Warnings

  • 2 invalid lines.
  • `host` is not a known field.