litter-robot.com
robots.txt
Robots Exclusion Standard data for litter-robot.com
Resource Scan
Scan Details
| Site Domain | litter-robot.com |
| Base Domain | litter-robot.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T13:13:52+00:00 |
| Next Scan | 2024-12-13T13:13:52+00:00 |
Last Scan
| Scanned | 2024-11-13T13:13:52+00:00 |
| URL | https://litter-robot.com/robots.txt |
| Redirect | https://www.litter-robot.com/robots.txt |
| Redirect Domain | www.litter-robot.com |
| Redirect Base | litter-robot.com |
| Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
| Redirect IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
| Response IP | 151.101.66.132 |
| Found | Yes |
| Hash | a742b53949cd2204c9c130a88f24f01ca2de6df29eb3254d57c2502988938765 |
| SimHash | 4f1d4a00a730 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | *productalert/add/ |
| Disallow | *customer/account/login/referer/ |
| Disallow | *review/product/listAjax/id |
| Disallow | *autopetsreviews/review/listAjax |
| Disallow | *customer/account/login/* |
| Disallow | *customer/account/forgotpassword/* |
| Disallow | *customer/account/login/ref* |
| Disallow | *autopetsfacebook* |
| Disallow | *autopetscategoryad* |
| Disallow | *page_view_event* |
| Disallow | *page_action* |
| Disallow | *page_view_timing* |
| Disallow | *session_trace* |
| Disallow | *jserrors* |
| Disallow | *ajax/aggregate* |
| Disallow | *spa/aggregate* |
| Disallow | *metrics/aggregate* |
| Disallow | */mapp/* |
| Disallow | */*?*srsltid=* |
| Disallow | */*?*litter_robot_model=* |
| Disallow | */*?*autopets_product_type=* |
| Disallow | */*?*autopets_product_type%5B1%5D=* |
| Disallow | */*?*autopets_product_type%5B0%5D=* |
| Disallow | */*?*utm_source=* |
| Disallow | */*?*utm_medium=* |
| Disallow | */*?*utm_campaign=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://litter-robot.com/sitemap_litterrobot.xml |