wa-state.cataloxy.us
robots.txt
Robots Exclusion Standard data for wa-state.cataloxy.us
Resource Scan
Scan Details
| Site Domain | wa-state.cataloxy.us |
| Base Domain | cataloxy.us |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-10-20T03:19:47+00:00 |
| Next Scan | 2025-11-03T03:19:47+00:00 |
Last Successful Scan
| Scanned | 2025-10-05T03:14:23+00:00 |
| URL | https://wa-state.cataloxy.us/robots.txt |
| Domain IPs | 104.21.61.203, 172.67.214.114, 2606:4700:3030::6815:3dcb, 2606:4700:3037::ac43:d672 |
| Response IP | 104.21.61.203 |
| Found | Yes |
| Hash | e48f2776a6129903ab1c726098da08d55b2cf7f35c3f8660ae82bf28345e542f |
| SimHash | 0a16df63f150 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
oai-searchbot
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yahoo
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
mail.ru
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
applebot
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /*comments.htm?*aa |
| Disallow | /*comments.htm*comment_id%3D |
| Disallow | /*comments.htm*del_comment%3D |
| Disallow | /*comments.htm*confirm_send%3D |
| Disallow | /*agreement.htm?o |
| Disallow | /*?logout= |
| Disallow | /*regions*?cr= |
| Disallow | /setsubscribe |
| Disallow | *confirmedok%3D |
| Disallow | /board*?extend= |
| Disallow | /*?print= |
| Disallow | /*?*%40 |
| Disallow | /firms_rand_gold.htm* |
| Disallow | /services_b.php* |
| Disallow | /*%26df%5B |
| Disallow | /*%26df%5B |
| Disallow | /*?df%5B |
| Disallow | /*?df%5B |
| Disallow | /cabinet/* |
| Disallow | /informers/? |
| Disallow | /*?*payment |
| Disallow | /*?change_city |
| Disallow | /*?add= |
| Disallow | /*%26add%3D |
| Disallow | /end.php |
| Disallow | /decode-encoded |
| Disallow | /*?cataloxy |
| Disallow | /*%26cataloxy |
| Disallow | /feedback/?qT |
| Disallow | *setlist%5Bdelivery%5D* |
| Disallow | *setlist%5Bdelivery* |
| Disallow | *setlist%5Bpriority%5D* |
| Disallow | *setlist%5Bpriority* |
| Disallow | /favorite.htm$ |
| Disallow | /rabota/*?pr= |
| Disallow | /*keyword%3D |
| Disallow | *%26txt |
| Disallow | *?txt |
| Disallow | /url/ |
| Disallow | /robox_notification.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
Warnings
- `clean-param` is not a known field.