Log In Sign Up

monitor.net.ru
robots.txt

Robots Exclusion Standard data for monitor.net.ru

Resource Scan

Scan Details

Site Domain monitor.net.ru
Base Domain monitor.net.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T20:46:43+00:00
Next Scan 2024-11-20T20:46:43+00:00

Last Successful Scan

Scanned2023-10-11T22:22:35+00:00
URL https://monitor.net.ru/robots.txt
Domain IPs 104.21.65.189, 172.67.191.126, 2606:4700:3036::ac43:bf7e, 2606:4700:3037::6815:41bd
Response IP 172.67.191.126
Found Yes
Hash e1255e277b74f705c7c566e0a97a8574f04baebc590e5b0f397331687f58a3b7
SimHash bd419c5bed91

Groups

*

Rule Path
Disallow /forum/account/
Disallow /forum/admin.php
Disallow /forum/birthdays/
Disallow /forum/find-new/
Disallow /forum/forums/*/?direction
Disallow /forum/forums/*/?order
Disallow /forum/forums/*/mark-read?date
Disallow /forum/forums/*/page-*?order
Disallow /forum/lost-password/
Disallow /forum/members/
Disallow /forum/moderation-queue/
Disallow /forum/online/
Disallow /forum/pages/privacy/
Disallow /forum/recent-activity/
Disallow /forum/resources/*/download?version
Disallow /forum/resources/*/history
Disallow /forum/resources/*resource_update_id
Disallow /forum/resources/authors/
Disallow /forum/resources/categories/*/?order*
Disallow /forum/forums/*prefix_id
Disallow /remont-service
Disallow /forum/threads/*/poll
Disallow /forum/watched/
Disallow /forums/*/?direction
Disallow /*?action*
Disallow /*?mode*
Disallow /forums/*/?order*
Disallow /forums/*?_debug=1
Disallow /forums/*no_date_limit%3D1
Disallow /forum/download.php*
Disallow /forum/whats-new/resources/
Disallow /*viewprofile
Disallow /forum/*%26highlight%3D*
Disallow /forum/*%26nojs%3D*
Disallow /forum/*%26order%3D*

googlebot

Rule Path
Disallow /forum/members/*
Disallow /forum/search/search
Disallow */reply?quote
Disallow */react?reaction_id
Disallow /forum/account/
Disallow /forum/admin.php
Disallow /forum/birthdays/
Disallow /forum/find-new/
Disallow /forum/forums/*/?direction
Disallow /forum/forums/*/?order
Disallow /forum/forums/*/mark-read?date
Disallow /forum/forums/*/page-*?order
Disallow /forum/lost-password/
Disallow /forum/members/
Disallow /forum/moderation-queue/
Disallow /forum/online/
Disallow /forum/pages/privacy/
Disallow /forum/recent-activity/
Disallow /forum/resources/*/download?version
Disallow /forum/resources/*/history
Disallow /forum/resources/*resource_update_id
Disallow /forum/resources/authors/
Disallow /forum/resources/categories/*/?order*
Disallow /forum/forums/*prefix_id
Disallow /remont-service
Disallow /forum/threads/*/poll
Disallow /forum/watched/
Disallow /forums/*/?direction
Disallow /*?action*
Disallow /*?mode*
Disallow /forums/*/?order*
Disallow /forums/*?_debug=1
Disallow /forums/*no_date_limit%3D1
Disallow /forum/download.php*
Disallow /forum/whats-new/resources/
Disallow /*viewprofile
Disallow /forum/*%26highlight%3D*
Disallow /forum/*%26nojs%3D*
Disallow /forum/*%26order%3D*

yandex

Rule Path
Disallow /forum/members/*
Disallow /forum/search/search
Disallow */reply?quote
Disallow */react?reaction_id
Disallow /*?amp=1
Disallow

ahrefsbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /forum/post*
Disallow /forum/attachments/
Disallow /forum/css*
Disallow /forum/js*

ia_archiver

Rule Path
Disallow /forum/pages/file_upload/
Back to top

Other Records

Field Value
sitemap https://monitor.net.ru/forum/sitemap.xml
Back to top

Comments

  • Disallow: /forum/redirect*
  • Disallow: /forum/dload.php
  • Disallow: /forum/whats-new/
  • Disallow: /forum/attachments/
  • Disallow: /forum/conversations/
  • Disallow: /forum/login.php
  • Disallow: /forum/login/
  • Disallow: /forum/logout/
  • Disallow: /forum/posts/
  • Disallow: /forum/register
  • Disallow: /forum/pages/file_upload/*/download
  • Disallow: /forum/forums/*solution_state
  • Disallow: /forum/pages/file_upload/*/download
  • Disallow: /forum/pages/file_upload/*/review/*/
  • Disallow: /forum/search
  • Disallow: /forum/search.php
  • Disallow: /forum/search/
  • Disallow: /forum/threads/*/reply
  • Disallow: /*/editprefix
  • Disallow: /forum/*/location-info
  • Disallow: /forum/*/location-info*
  • Disallow: /forum/css.php?css=__SENTINEL__*
  • Disallow: /forum/whats-new/posts/
  • Disallow: /forum/threads/*/?amp=1
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top