timeweb.com
robots.txt
Robots Exclusion Standard data for timeweb.com
Resource Scan
Scan Details
| Site Domain | timeweb.com |
| Base Domain | timeweb.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T10:26:49+00:00 |
| Next Scan | 2024-11-19T10:26:49+00:00 |
Last Scan
| Scanned | 2024-10-20T10:26:49+00:00 |
| URL | https://timeweb.com/robots.txt |
| Domain IPs | 185.65.148.89 |
| Response IP | 185.65.148.89 |
| Found | Yes |
| Hash | 6282e2e2d496d9499a59123df2f7e9945009c7c83f5a60a78c33356117502e87 |
| SimHash | 24059d5bc5ad |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */index.php |
| Disallow | */search |
| Disallow | /upload/ |
| Disallow | /examples/my-components/ |
| Disallow | /examples/download/download_private/ |
| Disallow | */user/ |
| Disallow | */login |
| Disallow | /*logout |
| Disallow | /personal/ |
| Disallow | /*auth |
| Disallow | /*backurl%3D |
| Disallow | /club/$ |
| Disallow | /club/messages/ |
| Disallow | /club/log/ |
| Disallow | /club/gallery/tags/ |
| Disallow | /content/board/my/ |
| Disallow | /content/links/my/ |
| Disallow | /*PAGE_NAME |
| Disallow | /*bitrix*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /catalog.php* |
| Disallow | */error_domain.htm* |
| Disallow | /error-blocked/* |
| Disallow | /error-domain/* |
| Disallow | /*/slide_show/ |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*bitrix_include_areas%3D |
| Disallow | /*clear_cache |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*PAGEN |
| Disallow | /*print_course%3D |
| Disallow | */order/ |
| Disallow | */intel-xeon |
| Disallow | */apple_time |
| Disallow | /ru/help/pages/*ga%3D |
| Disallow | /de |
| Disallow | |
| Disallow | *.htm |
| Disallow | */add |
| Disallow | */favorite |
| Disallow | */like |
| Disallow | /composite.txt |
| Disallow | /ru/services/vds-new/ |
| Disallow | */subscribe/ |
| Disallow | /?page_id |
| Disallow | /ru/services/domains/parking/ |
| Disallow | /ru/services/vds-50/ |
| Disallow | */templateshop/ |
| Disallow | /*?* |
| Disallow | /ru/community/questions |
| Disallow | /ru/community/marketplace |
| Disallow | /ru/community/orders |
| Allow | */*community/*?page=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | */medialibrary |
| Allow | */resize_cache |
| Allow | *.jpg |
| Allow | *.png |
| Allow | *.jpeg |
| Allow | *.svg |
| Allow | *.gif |
| Allow | |
| Allow | *.mp4 |
| Allow | *search*.js |
| Allow | *like*.png |
| Allow | *.webp |
Other Records
| Field | Value |
|---|---|
| sitemap | https://timeweb.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.