eaomedia.ru
robots.txt

Robots Exclusion Standard data for eaomedia.ru

Resource Scan

Scan Details

Site Domain eaomedia.ru
Base Domain eaomedia.ru
Scan Status Ok
Last Scan2024-05-31T06:33:09+00:00
Next Scan 2024-06-07T06:33:09+00:00

Last Scan

Scanned2024-05-31T06:33:09+00:00
URL https://eaomedia.ru/robots.txt
Domain IPs 104.21.5.172, 172.67.133.169, 2606:4700:3033::6815:5ac, 2606:4700:3033::ac43:85a9
Response IP 172.67.133.169
Found Yes
Hash b66b0e29bbaf2b229ae35ec482ad92bfeabb86a73e6b1cd43a484798ac743a1d
SimHash 6710ccd18111

Groups

yandex

Rule Path
Allow /export/new/news11.rss
Allow /journal/yandex_rss/all/

*

Rule Path
Allow /export/news.xml
Allow /news/apec
Disallow /aboutus
Disallow /p3
Disallow /p3_08.04
Disallow /p3_20.05
Disallow /admin
Disallow /travel/old
Disallow /user
Disallow /forum
Disallow /news/send/
Disallow /news/save/
Disallow /news/translate/
Disallow /news.htm
Disallow /news.txt
Disallow /vladivostoktimes
Disallow /afisha
Disallow /economics
Disallow /sport
Disallow /apec
Disallow /push
Disallow /connect
Disallow /connect/cp
Disallow /pda
Disallow /zakup
Disallow /wap
Disallow /old
Disallow /test
Disallow /phpajax
Disallow /_oldonline
Disallow /_online
Disallow /search
Disallow /glossary
Disallow /glossary/news/9594/
Disallow /glossary/news/9593/
Disallow /news/eao
Disallow /news/birobidjan
Disallow /news/khabarovsk
Disallow /news/khabkrai
Disallow /news/irkutsk
Disallow /news/oblast
Disallow /news/sakhalin/
Disallow /news/island/
Disallow /pda
Disallow /user/adverts
Disallow /archive
Disallow /news/hashtag/
Disallow /auto/badcopslist.php
Disallow /*/?nocache
Disallow /news/longread/
Disallow /news/articles/

Other Records

Field Value
crawl-delay 100

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://eaomedia.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.