tender.pro
robots.txt
Robots Exclusion Standard data for tender.pro
Resource Scan
Scan Details
| Site Domain | tender.pro |
| Base Domain | tender.pro |
| Scan Status | Ok |
| Last Scan | 2024-08-27T03:05:18+00:00 |
| Next Scan | 2024-09-26T03:05:18+00:00 |
Last Scan
| Scanned | 2024-08-27T03:05:18+00:00 |
| URL | https://tender.pro/robots.txt |
| Redirect | https://www.tender.pro/robots.txt |
| Redirect Domain | www.tender.pro |
| Redirect Base | tender.pro |
| Domain IPs | 31.28.14.149 |
| Redirect IPs | 31.28.14.147 |
| Response IP | 31.28.14.147 |
| Found | Yes |
| Hash | d007b8bc478be590f7cc5baf2e1ed0544bb30e91b5b6585e0322f064cd2b9014 |
| SimHash | 33055ac7c3b3 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /api/my |
| Disallow | /api/staff |
| Disallow | /api/authorization |
| Disallow | /api/sys |
| Disallow | /api/tender/*/view_closed |
| Disallow | /api/error |
| Disallow | /api/not_auth |
| Disallow | /api/nomenclature |
| Disallow | /api/companies/search |
| Disallow | /api/unsubscribe |
| Disallow | /api/tender/on_formir |
| Disallow | /api/price_search |
| Disallow | /cgi-bin |
| Disallow | /fullcatalog |
| Disallow | /wk |
| Disallow | /?ref |
| Disallow | /login-no-ssl.shtml |
| Disallow | /view_tender.shtml |
| Disallow | /edit_tender.shtml |
| Disallow | /api/forum/search |
| Disallow | /index_old.shtml |
| Allow | /api/sys_news |
| Allow | /api/nomenclature/list |
| Allow | /api/nomenclature/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /api/my |
| Disallow | /api/staff |
| Disallow | /api/authorization |
| Disallow | /api/sys |
| Disallow | /api/tender/*/view_closed |
| Disallow | /api/error |
| Disallow | /api/not_auth |
| Disallow | /api/nomenclature |
| Disallow | /api/companies/search |
| Disallow | /api/unsubscribe |
| Disallow | /api/tender/on_formir |
| Disallow | /api/price_search |
| Disallow | /cgi-bin |
| Disallow | /fullcatalog |
| Disallow | /wk |
| Disallow | /?ref |
| Disallow | /login-no-ssl.shtml |
| Disallow | /view_tender.shtml |
| Disallow | /edit_tender.shtml |
| Disallow | /api/forum/search |
| Disallow | /index_old.shtml |
| Allow | /api/sys_news |
| Allow | /api/nomenclature/list |
| Allow | /api/nomenclature/report |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments