readytodirt.ru
robots.txt
Robots Exclusion Standard data for readytodirt.ru
Resource Scan
Scan Details
| Site Domain | readytodirt.ru |
| Base Domain | readytodirt.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-04T23:05:39+00:00 |
| Next Scan | 2024-12-04T23:05:39+00:00 |
Last Scan
| Scanned | 2024-11-04T23:05:39+00:00 |
| URL | https://readytodirt.ru/robots.txt |
| Domain IPs | 87.242.71.207 |
| Response IP | 87.242.71.207 |
| Found | Yes |
| Hash | f17897ff360bc690ce52fcdf1ffa1a5c60090a449a36f2f9f4f0f1581426c575 |
| SimHash | 626edff04aa8 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /templates/gk_bikestore/ |
| Allow | /components/com_virtuemart/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /templates/gk_bikestore/*.css |
| Allow | /templates/gk_bikestore/*.js |
| Allow | /templates/gk_bikestore/*.png |
| Allow | /templates/gk_bikestore/*.jpg |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /media/*.png |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Allow | /images/*.jpg |
| Allow | /images/*.png |
| Allow | /components/com_virtuemart/assets/css/*.css |
| Allow | /components/com_virtuemart/assets/js/*.js |
| Allow | /components/com_virtuemart/assets/*.png |
| Allow | /modules/*.png |
| Allow | /modules/*.css |
| Allow | /modules/mod_accordion_menu/cache/*.css |
| Allow | /modules/mod_accordion_menu/*.css |
| Allow | /modules/mod_smfaq/*.css |
| Allow | /modules/mod_smfaq/*.js |
| Allow | /media/dojo/*.js |
| Allow | /cache/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.js |
| Disallow | /modules/mod_virtuemart_param_filter/*.gif |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /404 |
| Disallow | /*search%3D* |
| Disallow | /*cart* |
| Disallow | /*mod_virtuemart_param_filter* |
| Disallow | /*recommend?* |
| Disallow | /*offlajnparams* |
| Disallow | /*askquestion* |
| Disallow | *keyword%3D* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
yandex
| Rule | Path |
|---|---|
| Allow | /templates/gk_bikestore/ |
| Allow | /components/com_virtuemart/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /templates/gk_bikestore/*.css |
| Allow | /templates/gk_bikestore/*.js |
| Allow | /templates/gk_bikestore/*.png |
| Allow | /templates/gk_bikestore/*.jpg |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /media/*.png |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Allow | /images/*.jpg |
| Allow | /images/*.png |
| Allow | /components/com_virtuemart/assets/css/*.css |
| Allow | /components/com_virtuemart/assets/js/*.js |
| Allow | /components/com_virtuemart/assets/*.png |
| Allow | /modules/*.png |
| Allow | /modules/*.css |
| Allow | /modules/mod_accordion_menu/cache/*.css |
| Allow | /modules/mod_accordion_menu/*.css |
| Allow | /modules/mod_smfaq/*.css |
| Allow | /modules/mod_smfaq/*.js |
| Allow | /media/dojo/*.js |
| Allow | /cache/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.js |
| Disallow | /modules/mod_virtuemart_param_filter/*.gif |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /404 |
| Disallow | /*search%3D* |
| Disallow | /*cart* |
| Disallow | /*mod_virtuemart_param_filter* |
| Disallow | /*offlajnparams* |
| Disallow | /*askquestion* |
| Disallow | *keyword%3D* |
| Disallow | /*recommend?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
msnbot
| Rule | Path |
|---|---|
| Allow | /templates/gk_bikestore/ |
| Allow | /components/com_virtuemart/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /templates/gk_bikestore/*.css |
| Allow | /templates/gk_bikestore/*.js |
| Allow | /templates/gk_bikestore/*.png |
| Allow | /templates/gk_bikestore/*.jpg |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /media/*.png |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Allow | /images/*.jpg |
| Allow | /images/*.png |
| Allow | /components/com_virtuemart/assets/css/*.css |
| Allow | /components/com_virtuemart/assets/js/*.js |
| Allow | /components/com_virtuemart/assets/*.png |
| Allow | /modules/*.png |
| Allow | /modules/*.css |
| Allow | /modules/mod_accordion_menu/cache/*.css |
| Allow | /modules/mod_accordion_menu/*.css |
| Allow | /modules/mod_smfaq/*.css |
| Allow | /modules/mod_smfaq/*.js |
| Allow | /media/dojo/*.js |
| Allow | /cache/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.css |
| Disallow | /modules/mod_virtuemart_param_filter/*.js |
| Disallow | /modules/mod_virtuemart_param_filter/*.gif |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /404 |
| Disallow | /*search%3D* |
| Disallow | /*cart* |
| Disallow | /*mod_virtuemart_param_filter* |
| Disallow | /*offlajnparams* |
| Disallow | /*askquestion* |
| Disallow | *keyword%3D* |
| Disallow | /*recommend?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Warnings
- `host` is not a known field.
Comments