beton.ru
robots.txt

Robots Exclusion Standard data for beton.ru

Resource Scan

Scan Details

Site Domain beton.ru
Base Domain beton.ru
Scan Status Ok
Last Scan2024-11-16T21:05:12+00:00
Next Scan 2024-11-23T21:05:12+00:00

Last Scan

Scanned2024-11-16T21:05:12+00:00
URL https://beton.ru/robots.txt
Domain IPs 85.92.111.40
Response IP 85.92.111.40
Found Yes
Hash ce3d77f79604f143e97d756a97fd40f210e44a0262e159ad40ae9f6f3d875063
SimHash 0404d96375ba

Groups

*

Rule Path
Disallow /bitrix/
Disallow /upload/
Disallow /search/
Allow /search/map.php
Disallow /banner/
Disallow /club/search/
Disallow /club/group/search/
Disallow /club/forum/search/
Disallow /communication/forum/search/
Disallow /communication/blog/search.php
Disallow /club/gallery/tags/
Disallow /examples/my-components/
Disallow /examples/download/download_private/
Disallow /auth/*
Disallow /auth.php
Disallow /personal/
Disallow /communication/forum/user/
Disallow /e-store/paid/detail.php
Disallow /e-store/affiliates/
Disallow /club/$
Disallow /club/messages/
Disallow /club/log/
Disallow /content/board/my/
Disallow /content/links/my/
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3DADD_TO_COMPARE_LIST
Disallow /*action%3DDELETE_FROM_COMPARE_LIST
Disallow /*action%3DADD2BASKET
Disallow /*action%3DBUY
Disallow /*print_course%3DY
Disallow /*backurl%3D*
Disallow /m.php
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /catalog/*?SHOWALL_1=1
Disallow *SHOWALL_1%3D*
Disallow /banner/*

Warnings

  • `host` is not a known field.