platan.ru
robots.txt
Robots Exclusion Standard data for platan.ru
Resource Scan
Scan Details
| Site Domain | platan.ru |
| Base Domain | platan.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-20T19:40:26+00:00 |
| Next Scan | 2024-11-19T19:40:26+00:00 |
Last Scan
| Scanned | 2024-10-20T19:40:26+00:00 |
| URL | https://platan.ru/robots.txt |
| Redirect | https://www.platan.ru/robots.txt |
| Redirect Domain | www.platan.ru |
| Redirect Base | platan.ru |
| Domain IPs | 213.189.211.128 |
| Redirect IPs | 213.189.211.128 |
| Response IP | 213.189.211.128 |
| Found | Yes |
| Hash | d3053e508f4b810c8484eb045224a9a45f71014297a7c58e12ee4b190600e4c3 |
| SimHash | 6600878553f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*utm |
| Disallow | /*openstat |
| Disallow | /*gclid |
| Disallow | *short%3Dyes$ |
| Disallow | /cgi-bin/shop_basket.pl |
| Disallow | /cgi-bin/qwery_i.pl |
| Disallow | /cgi-bin/shop_user.pl |
| Disallow | /cgi-bin/shop_order.pl |
| Disallow | /cgi-bin/shop_favorite.pl |
| Disallow | /cgi-bin/login.pl |
| Disallow | /cgi-bin/search.pl |
| Disallow | /cgi-bin/order_edit.pl |
| Disallow | /cgi-bin/qweryv.pl |
| Disallow | /shop/*?$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `clean-param` is not a known field.