morfonline.ru
robots.txt

Robots Exclusion Standard data for morfonline.ru

Resource Scan

Scan Details

Site Domain morfonline.ru
Base Domain morfonline.ru
Scan Status Ok
Last Scan2024-10-01T00:44:07+00:00
Next Scan 2024-10-08T00:44:07+00:00

Last Scan

Scanned2024-10-01T00:44:07+00:00
URL https://morfonline.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:3:0:201, 37.140.192.96
Response IP 37.140.192.96
Found Yes
Hash e7a4fccc18173ba91f25431c35ef7c9f67318bbe4b2f892066ecca5fa2473927
SimHash 407435c3c2f3

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /wp-json/*
Disallow /?
Disallow */page/*
Disallow /*/page/*
Disallow /*/*/page/*
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /wp-json/*
Disallow /?
Disallow */page/*
Disallow /*/page/*
Disallow /*/*/page/*
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

esobisubscriber
exabot
mj12bot
semrushbot
semrushbot-sa

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

proximic

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

webinject

Rule Path
Disallow /

spbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

Warnings

  • `host` is not a known field.