cataloxy.ru
robots.txt
Robots Exclusion Standard data for cataloxy.ru
Resource Scan
Scan Details
Site Domain | cataloxy.ru |
Base Domain | cataloxy.ru |
Scan Status | Ok |
Last Scan | 2024-09-20T18:42:07+00:00 |
Next Scan | 2024-09-27T18:42:07+00:00 |
Last Scan
Scanned | 2024-09-20T18:42:07+00:00 |
URL | https://cataloxy.ru/robots.txt |
Domain IPs | 109.234.156.234 |
Response IP | 109.234.156.234 |
Found | Yes |
Hash | 09eed38b074407f143f22fbd930c83e847a5e6aae829cdd525bb0c9326d09bcc |
SimHash | 0a56de62f150 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Disallow | |
Disallow | /apple-touch-favicon.png |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
bingbot
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
bing
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
msnbot
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
msn
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
yahoo
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
mail.ru
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
*
Rule | Path |
---|---|
Disallow | /*comments.htm?*aa |
Disallow | /*comments.htm*comment_id%3D |
Disallow | /*comments.htm*del_comment%3D |
Disallow | /*comments.htm*confirm_send%3D |
Disallow | /*agreement.htm?o |
Disallow | /*?logout= |
Disallow | /*regions*?cr= |
Disallow | /setsubscribe |
Disallow | *confirmedok%3D |
Disallow | /board*?extend= |
Disallow | /*?print= |
Disallow | /*?*%40 |
Disallow | /firms_rand_gold.htm* |
Disallow | /services_b.php* |
Disallow | /*%26df%5B |
Disallow | /*%26df%5B |
Disallow | /*?df%5B |
Disallow | /*?df%5B |
Disallow | /cabinet/* |
Disallow | /informers/? |
Disallow | /*?*payment |
Disallow | /*?change_city |
Disallow | /*?add= |
Disallow | /*%26add%3D |
Disallow | /*?cataloxy |
Disallow | /*%26cataloxy |
Disallow | /feedback/?qT |
Disallow | *setlist%5Bdelivery%5D* |
Disallow | *setlist%5Bdelivery* |
Disallow | *setlist%5Bpriority%5D* |
Disallow | *setlist%5Bpriority* |
Disallow | /favorite.htm$ |
Disallow | /rabota/*?pr= |
Disallow | /*keyword%3D |
Disallow | *%26txt |
Disallow | *?txt |
Disallow | /url/ |
Disallow | /robox_notification.htm* |
Disallow | /apple-touch-favicon.png |
Warnings
- `clean-param` is not a known field.