marketnt.ru
robots.txt
Robots Exclusion Standard data for marketnt.ru
Resource Scan
Scan Details
| Site Domain | marketnt.ru |
| Base Domain | marketnt.ru |
| Scan Status | Ok |
| Last Scan | 2024-08-25T22:55:13+00:00 |
| Next Scan | 2024-09-24T22:55:13+00:00 |
Last Scan
| Scanned | 2024-08-25T22:55:13+00:00 |
| URL | https://marketnt.ru/robots.txt |
| Domain IPs | 92.53.96.102 |
| Response IP | 92.53.96.102 |
| Found | Yes |
| Hash | eb49c15c72da8b29415e810e8da1c5d1b275e31b967413917e119151caad0e54 |
| SimHash | 0a44c143c59b |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | *price%5Bmin%5D | - |
| Disallow | *price%5Bmax%5D | - |
| Disallow | /bitrix/ | - |
| Disallow | /search/ | - |
| Disallow | /catalog/compare.php | - |
| Allow | /search/map/ | - |
| Disallow | /brands/ | - |
| Disallow | /club/search/ | - |
| Disallow | /club/group/search/ | - |
| Disallow | /club/forum/search/ | - |
| Disallow | /communication/forum/search/ | - |
| Disallow | /communication/blog/search.php | - |
| Disallow | /club/gallery/tags/ | - |
| Disallow | /examples/my-components/ | - |
| Disallow | /examples/download/download_private/ | - |
| Disallow | /auth/ | - |
| Disallow | /auth.php | - |
| Disallow | /personal/ | - |
| Disallow | /communication/forum/user/ | - |
| Disallow | /e-store/paid/detail.php | - |
| Disallow | /e-store/affiliates/ | - |
| Disallow | /club/$ | - |
| Disallow | /club/messages/ | - |
| Disallow | /club/log/ | - |
| Disallow | /content/board/my/ | - |
| Disallow | /content/links/my/ | - |
| Disallow | /*/search/ | - |
| Disallow | /*PAGE_NAME%3Dsearch | - |
| Disallow | /*PAGE_NAME%3Duser_post | - |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show | - |
| Disallow | /*/slide_show/ | - |
| Disallow | /*/gallery/*order%3D* | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*action%3DADD_TO_COMPARE_LIST | - |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST | - |
| Disallow | /*action%3DADD2BASKET | - |
| Disallow | /*action%3DBUY | - |
| Disallow | /*print_course%3DY | - |
| Disallow | /*bitrix_*%3D | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*BACKURL%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*id%3D* | - |
| Disallow | /*BACK_URL%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | *index.php | - |
| Disallow | *rss | - |
| Disallow | *accessories_for | - |
| Disallow | *s%3D | - |
| Disallow | *page%3D | - |
| Disallow | /comments | - |
| Disallow | *?SHOWALL | - |
| Disallow | *?PAGEN | - |
| Disallow | *z%3D | - |
| Disallow | *r1%3D | - |
| Disallow | *yandext | - |
| Disallow | */filter/* | - |
| Disallow | /basket/ | - |
| Disallow | /order/ | - |
| Disallow | /include/licenses_detail.php | - |
| Disallow | /*?* | - |
| Disallow | /company/licenses/* | - |
| Allow | /company/licenses/$ | - |
| Allow | */upload/ | открываем папку с файлами uploads |
| Allow | /bitrix/*.js | здесь и далее открываем для индексации скрипты |
| Allow | /bitrix/*.css | - |
| Allow | /local/*.js | - |
| Allow | /local/*.css | - |
| Allow | /local/*.jpg | - |
| Allow | /local/*.jpeg | - |
| Allow | /local/*.png | - |
| Allow | /local/*.gif | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://marketnt.ru/setimap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.