wsem.ru
robots.txt
Robots Exclusion Standard data for wsem.ru
Resource Scan
Scan Details
| Site Domain | wsem.ru |
| Base Domain | wsem.ru |
| Scan Status | Ok |
| Last Scan | 2025-04-15T04:31:23+00:00 |
| Next Scan | 2025-04-22T04:31:23+00:00 |
Last Scan
| Scanned | 2025-04-15T04:31:23+00:00 |
| URL | https://wsem.ru/robots.txt |
| Domain IPs | 104.26.0.82, 104.26.1.82, 172.67.71.55, 2606:4700:20::681a:152, 2606:4700:20::681a:52, 2606:4700:20::ac43:4737 |
| Response IP | 104.26.0.82 |
| Found | Yes |
| Hash | 2db26f825e13c616076e2fae9d4a5740fb1254e36dacb8990f19cbdd912cbfa4 |
| SimHash | a2249d6ee73b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ria-map.php |
| Disallow | /typograf_/ |
| Disallow | /publikatsiya-na-sayte-old/ |
| Disallow | /channel-test/ |
| Disallow | /components/ |
| Disallow | /test/ |
| Disallow | /stats/ |
| Disallow | /bitrix/ |
| Disallow | /upload/ |
| Disallow | /search/ |
| Disallow | /include/* |
| Disallow | /auth/ |
| Disallow | /auth.php |
| Disallow | /personal/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26amp%3Bprint%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*print_course%3DY |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*index.php$ |
| Disallow | /index.php* |
| Disallow | /user/* |
| Disallow | /editor/* |
| Disallow | /draft/* |
| Disallow | /moder_public/* |
| Disallow | /channel/* |
| Disallow | /?* |
| Disallow | /*?* |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.png |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wsem.ru/sitemap_index.xml |
| sitemap | https://wsem.ru/sitemap.xml |