eu.aurora.network
robots.txt

Robots Exclusion Standard data for eu.aurora.network

Resource Scan

Scan Details

Site Domain eu.aurora.network
Base Domain aurora.network
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-13T21:43:18+00:00
Next Scan 2025-11-12T21:43:18+00:00

Last Successful Scan

Scanned2025-08-22T15:47:07+00:00
URL https://eu.aurora.network/robots.txt
Redirect https://kosmetista.ru/robots.txt
Redirect Domain kosmetista.ru
Redirect Base kosmetista.ru
Domain IPs 104.21.64.162, 172.67.152.195, 2606:4700:3031::6815:40a2, 2606:4700:3034::ac43:98c3
Redirect IPs 79.174.15.177
Response IP 79.174.15.177
Found Yes
Hash 8283bc2b17e03d5c70d96ff2ded2818a995dc8e6c31e75b1a0e067a7e8f8e382
SimHash 0c936ea2f6b3

Groups

yandex

Rule Path
Disallow /talk
Disallow /classes
Disallow /config
Disallow /logs
Disallow /login
Disallow /updates
Disallow /page
Disallow /my
Disallow /w
Disallow /tag_communities
Disallow /registration
Disallow /adv
Disallow /catalog/reviewadd
Disallow /catalog/search
Disallow /rss/tag
Disallow /rss/comments
Disallow /tags
Disallow /search/comments
Disallow /achievements
Disallow /comments
Disallow /feed
Disallow /top
Disallow /people
Disallow /search
Disallow /tag_multi
Disallow /blog/good
Disallow /oauth
Disallow /topic
Disallow /*mobile%3D*
Disallow /catalog/posts
Disallow /reviews*sort%3D*
Disallow /catalog/reviews/1*
Disallow /catalog/reviews/2*
Disallow /catalog/reviews/3*
Disallow /catalog/reviews/4*
Disallow /catalog/reviews/5*
Disallow /catalog/reviews/6*
Disallow /catalog/reviews/7*
Disallow /catalog/reviews/8*
Disallow /catalog/reviews/9*
Disallow /catalog/reviews/brand/*
Disallow /brand/*
Disallow /brand*/products
Disallow /catalog/reviewaddng
Disallow /profile/*/favourites
Disallow /pinned
Disallow /tag/*blog%3D
Disallow /catalog/products/new/*
Disallow /fresh/*/page
Disallow /blog/voice*
Disallow /bloggers
Disallow /award
Disallow /company
Disallow /flow
Disallow /tgram
Disallow /support
Disallow /stream
Disallow /settings*
Disallow /chillout/page*
Disallow /sandbox/page*
Disallow /profile/*/page*
Disallow /personal_blog/*/page*
Disallow /blog/kosmetichka/*
Disallow /blog/help_support/*
Disallow /brand?query=*
Disallow /flashmob/*/page*

*

Rule Path
Disallow /talk
Disallow /classes
Disallow /config
Disallow /logs
Disallow /login
Disallow /updates
Disallow /page
Disallow /my
Disallow /w
Disallow /tag_communities
Disallow /registration
Disallow /adv
Disallow /catalog/reviewadd
Disallow /catalog/search
Disallow /rss/tag
Disallow /rss/comments
Disallow /tags
Disallow /search/comments
Disallow /achievements
Disallow /comments
Disallow /feed
Disallow /top
Disallow /people
Disallow /search
Disallow /tag_multi
Disallow /blog/good
Disallow /oauth
Disallow /topic
Disallow /*mobile%3D*
Disallow /catalog/posts
Disallow /reviews*sort%3D*
Disallow /catalog/reviews/1*
Disallow /catalog/reviews/2*
Disallow /catalog/reviews/3*
Disallow /catalog/reviews/4*
Disallow /catalog/reviews/5*
Disallow /catalog/reviews/6*
Disallow /catalog/reviews/7*
Disallow /catalog/reviews/8*
Disallow /catalog/reviews/9*
Disallow /catalog/reviews/brand/*
Disallow /brand/*
Disallow /brand*/products
Disallow /catalog/reviewaddng
Disallow /profile/*/favourites
Disallow /pinned
Disallow /tag/*blog%3D
Disallow /tag/*flow%3D
Disallow /catalog/products/new/*
Disallow /fresh/*/page
Disallow /blog/voice*
Disallow /bloggers
Disallow /award
Disallow /company
Disallow /flow
Disallow /tgram
Disallow /support
Disallow /stream
Disallow /settings*
Disallow /chillout/page*
Disallow /sandbox/page*
Disallow /profile/*/page*
Disallow /personal_blog/*/page*
Disallow /blog/kosmetichka/*
Disallow /blog/help_support/*
Disallow /brand?query=*
Disallow /flashmob/*/page*

Other Records

Field Value
sitemap https://kosmetista.ru/yandex_sitemap.xml

Comments

  • Disallow: /include
  • NEW 6 july 2020
  • NEW 8 july 2020
  • NEW 30 march 2020
  • Disallow: /include
  • NEW 6 july 2020
  • NEW 8 july 2020
  • NEW 30 march 2020

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.