morfemonline.ru
robots.txt

Robots Exclusion Standard data for morfemonline.ru

Resource Scan

Scan Details

Site Domain morfemonline.ru
Base Domain morfemonline.ru
Scan Status Ok
Last Scan2024-09-30T02:55:33+00:00
Next Scan 2024-10-07T02:55:33+00:00

Last Scan

Scanned2024-09-30T02:55:33+00:00
URL https://morfemonline.ru/robots.txt
Domain IPs 37.140.192.96
Response IP 37.140.192.96
Found Yes
Hash e9e970b6ea651a9355922ffee068c2454f26720ece1a124b7f78bd120c3ac07c
SimHash 027435c3c2f3

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /wp-json/*
Disallow /?
Disallow */page/*
Disallow /*/page/*
Disallow /*/*/page/*
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /wp-json/*
Disallow /?
Disallow */page/*
Disallow /*/page/*
Disallow /*/*/page/*
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

esobisubscriber
exabot
mj12bot
semrushbot
semrushbot-sa

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

proximic

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

webinject

Rule Path
Disallow /

spbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

Warnings

  • `host` is not a known field.