myotpusk.com
robots.txt

Robots Exclusion Standard data for myotpusk.com

Resource Scan

Scan Details

Site Domain myotpusk.com
Base Domain myotpusk.com
Scan Status Ok
Last Scan2024-11-09T19:33:45+00:00
Next Scan 2024-12-09T19:33:45+00:00

Last Scan

Scanned2024-11-09T19:33:45+00:00
URL http://myotpusk.com/robots.txt
Domain IPs 212.66.44.50
Response IP 212.66.44.50
Found Yes
Hash 5c7765ed0db32a0f0b28db523272ee447f7fab8ac841e2d37c69ff071b0ec512
SimHash 4ff1c55753b1

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

apis-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

google-read-aloud

Rule Path
Allow /

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexaccessibilitybot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexadnet

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexblogs

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexcalendar

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexdirect

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexdirectdyn

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexfavicons

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yadirectfetcher

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexfordomain

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandeximages

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandeximageresizer

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmobilebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmarket

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmedia

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmetrika

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmobilescreenshotbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexnews

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexontodb

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexontodbapi

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexpagechecker

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexpartner

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexrca

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexsearchshop

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexsitelinks

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexspravbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandextracker

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexturbo

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexvertis

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexverticals

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexvideo

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexvideoparser

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexwebmaster

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexscreenshotbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandexmedianabot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

mail.ru

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

mail.ru_bot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

stackrambler

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Warnings

  • `host` is not a known field.