company.rt.ru
robots.txt
Robots Exclusion Standard data for company.rt.ru
Resource Scan
Scan Details
| Site Domain | company.rt.ru |
| Base Domain | rt.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-03T00:38:28+00:00 |
| Next Scan | 2024-06-17T00:38:28+00:00 |
Last Scan
| Scanned | 2024-06-03T00:38:28+00:00 |
| URL | https://company.rt.ru/robots.txt |
| Redirect | https://www.company.rt.ru/robots.txt |
| Redirect Domain | www.company.rt.ru |
| Redirect Base | rt.ru |
| Domain IPs | 213.59.197.65 |
| Redirect IPs | 95.167.23.65 |
| Response IP | 95.167.23.65 |
| Found | Yes |
| Hash | cdf10fe44f7fe91721040f75d1450e9f648c2bfb489557380afcb2b6f273a592 |
| SimHash | 8716894ac128 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bitrix/ |
| Disallow | /admin/ |
| Disallow | /upload/ |
| Disallow | /images/ |
| Disallow | /search/ |
| Disallow | /*print%3DY$ |
| Allow | /map.php |
| Disallow | /search/map.php |
| Disallow | /auth/ |
| Disallow | /auth.php |
| Disallow | /*/search/ |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*print_course%3DY |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*index.php$ |
| Disallow | /img/ |
| Disallow | /js/ |
| Disallow | /q_script/ |
| Disallow | /inc_areas/ |
| Disallow | /new_assets/ |
| Disallow | /about/firm_style/ |
| Disallow | /social/kids/ |
| Disallow | /about/branches/moscow/contacts/cpoks/ |
| Disallow | /PR/ |
| Disallow | /test_clear_cache.php |
| Disallow | /about/disclosure/order641/ |
| Disallow | /ir/quick_analyzer/ |
| Disallow | /en/ir/quick_analyzer/ |
| Disallow | /regions/center/about/struct/ |
| Disallow | /regions/south/about/struct/ |
| Disallow | /regions/cc/ |
| Disallow | /regions/far_east/about/konkurs/ |
| Disallow | /regions/far_east/floodwaters/ |
| Disallow | /regions/far_east/about/disclosure/ |
| Disallow | /regions/far_east/about/minor_actives/ |
| Disallow | /en/about/partnership/ |
| Disallow | /about/partnership/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |