penoterm.ru
robots.txt
Robots Exclusion Standard data for penoterm.ru
Resource Scan
Scan Details
| Site Domain | penoterm.ru |
| Base Domain | penoterm.ru |
| Scan Status | Ok |
| Last Scan | 3/14/2025, 3:14:53 AM |
| Next Scan | 4/13/2025, 3:14:53 AM |
Last Scan
| Scanned | 3/14/2025, 3:14:53 AM |
| URL | https://penoterm.ru/robots.txt |
| Domain IPs | 91.201.52.102 |
| Response IP | 91.201.52.102 |
| Found | Yes |
| Hash | cfbda72c0b1ca3c669f745562bb1aa25c7da2d99dcee783792b5d3d615a7a627 |
| SimHash | 3916c82795b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /auth* |
| Disallow | /basket* |
| Disallow | /order* |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /test/ |
| Disallow | /ajax/ |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /bitrix/admin/ |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*print* |
| Disallow | /*action* |
| Disallow | /*register%3D |
| Disallow | /*password* |
| Disallow | /*login%3D |
| Disallow | /*type%3D |
| Disallow | /*sort%3D |
| Disallow | /*order%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*?utm_source= |
| Disallow | *?arrFilter* |
| Disallow | /*?section= |
| Disallow | /*?sphrase_id= |
| Disallow | /*?* |
| Disallow | *?q= |
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | /local/ |
| Disallow | /auth/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /test/ |
| Disallow | /ajax/ |
| Disallow | /bitrix/admin/ |
| Disallow | /captcha/ |
| Disallow | /feed/ |
| Disallow | /rss/ |
| Disallow | /rabota-u-nas/$ |
| Allow | /rabota-u-nas/vacancy/* |
| Disallow | *?FILTER* |
| Disallow | *?ei= |
| Disallow | *?p= |
| Disallow | *?q= |
| Disallow | *?tags= |
| Disallow | *B_ORDER%3D |
| Disallow | *BRAND%3D |
| Disallow | *CLEAR_CACHE%3D |
| Disallow | *ELEMENT_ID%3D |
| Disallow | *price_from%3D |
| Disallow | *price_to%3D |
| Disallow | *PROPERTY_TYPE%3D |
| Disallow | *PROPERTY_WIDTH%3D |
| Disallow | *PROPERTY_HEIGHT%3D |
| Disallow | *PROPERTY_DIA%3D |
| Disallow | *PROPERTY_OPENING_COUNT%3D |
| Disallow | *PROPERTY_SELL_TYPE%3D |
| Disallow | *PROPERTY_MAIN_TYPE%3D |
| Disallow | *PROPERTY_PRICE%5B*%5D%3D |
| Disallow | *S_LAST%3D |
| Disallow | *SECTION_ID%3D |
| Disallow | *SECTION%5B*%5D%3D |
| Disallow | *SHOWALL%3D |
| Disallow | *SHOW_ALL%3D |
| Disallow | *SHOWBY%3D |
| Disallow | *SORT%3D |
| Disallow | *SPHRASE_ID%3D |
| Disallow | *TYPE%3D |
| Disallow | *utm*%3D |
| Disallow | *openstat*%3D |
| Disallow | *from*%3D |
| Disallow | *index.php* |
| Disallow | *filter/clear/apply* |
| Allow | /gde-kupit/distribyutory-i-optovye-kompanii/$ |
| Disallow | /gde-kupit/distribyutory-i-optovye-kompanii/* |
| Allow | /gde-kupit/roznichnye-tochki-prodazh/$ |
| Disallow | /gde-kupit/roznichnye-tochki-prodazh/* |
| Disallow | *?tags_* |
| Disallow | */product2/* |
| Allow | */upload/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /local/*.js |
| Allow | /local/*.css |
| Allow | /local/*.jpg |
| Allow | /local/*.jpeg |
| Allow | /local/*.png |
| Allow | /local/*.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | https://penoterm.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.