colorsvet.ru
robots.txt
Robots Exclusion Standard data for colorsvet.ru
Resource Scan
Scan Details
| Site Domain | colorsvet.ru |
| Base Domain | colorsvet.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T15:06:32+00:00 |
| Next Scan | 2024-11-21T15:06:32+00:00 |
Last Scan
| Scanned | 2024-11-14T15:06:32+00:00 |
| URL | https://colorsvet.ru/robots.txt |
| Domain IPs | 5.23.50.101 |
| Response IP | 5.23.50.101 |
| Found | Yes |
| Hash | 80fc2bfe4842580a1bd0d2ba183c087f952b3682375f0dce567989fa67bea853 |
| SimHash | 62384ff048c9 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*.js* |
| Allow | /*.css* |
| Allow | /*.png* |
| Allow | /*.jpg* |
| Allow | /*.gif* |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /includes/ |
| Disallow | /component/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /*mailto* |
| Disallow | /*start* |
| Disallow | /*print* |
| Disallow | /*feed* |
| Disallow | /*search* |
| Disallow | /*users* |
| Disallow | /*profile* |
| Disallow | /*user/ |
| Disallow | /*? |
| Disallow | /*% |
| Disallow | /*%26 |
| Disallow | /*%3Drss |
| Disallow | /*%3Datom |
| Disallow | |
| Disallow | /*html |
| Disallow | /*results |
| Disallow | /*by%2Cproduct_name |
| Disallow | /*by%2Cmf_name |
| Disallow | /*by%2Cproduct_sku |
| Disallow | /*by%2Cproduct_price |
| Disallow | /*dirDesc |
| Disallow | /filter/ |
| Disallow | /*index.php |
| Disallow | /index.php* |
| Disallow | /404 |
| Allow | /index.php?option=com_jmap&view=sitemap&format=xml |
| Allow | /images/sale/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /includes/ |
| Disallow | /component/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /filter/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /*mailto* |
| Disallow | /*start* |
| Disallow | /*print* |
| Disallow | /*feed* |
| Disallow | /*search* |
| Disallow | /*users* |
| Disallow | /*profile* |
| Disallow | /*user/ |
| Disallow | /*? |
| Disallow | /*% |
| Disallow | /*%26 |
| Disallow | /*%3Drss |
| Disallow | /*%3Datom |
| Disallow | |
| Disallow | /*html |
| Disallow | /*results |
| Disallow | /*by%2Cproduct_name |
| Disallow | /*by%2Cmf_name |
| Disallow | /*by%2Cproduct_sku |
| Disallow | /*by%2Cproduct_price |
| Disallow | /*dirDesc |
| Disallow | /*index.php |
| Disallow | /index.php* |
| Disallow | /404 |
| Allow | /index.php?option=com_jmap&view=sitemap&format=xml |
| Allow | /images/sale/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /includes/ |
| Disallow | /component/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /*mailto* |
| Disallow | /*start* |
| Disallow | /*print* |
| Disallow | /*feed* |
| Disallow | /*search* |
| Disallow | /*users* |
| Disallow | /*profile* |
| Disallow | /*user/ |
| Disallow | /*? |
| Disallow | /*% |
| Disallow | /*%26 |
| Disallow | /*%3Drss |
| Disallow | /*%3Datom |
| Disallow | |
| Disallow | /*html |
| Disallow | /*results |
| Disallow | /*by%2Cproduct_name |
| Disallow | /*by%2Cmf_name |
| Disallow | /*by%2Cproduct_sku |
| Disallow | /*by%2Cproduct_price |
| Disallow | /*dirDesc |
| Disallow | /*index.php |
| Disallow | /index.php* |
| Disallow | /404 |
| Allow | /index.php?option=com_jmap&view=sitemap&format=xml |
| Allow | /images/sale/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://colorsvet.ru/sitemap.xml |
| sitemap | https://colorsvet.ru/sitemap.xml |
| sitemap | https://colorsvet.ru/sitemap.xml |
| sitemap | https://colorsvet.ru/index.php?option=com_jmap&view=sitemap&format=gnews |
Warnings
- `host` is not a known field.
Comments