paleovalley.com
robots.txt
Robots Exclusion Standard data for paleovalley.com
Resource Scan
Scan Details
| Site Domain | paleovalley.com |
| Base Domain | paleovalley.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-01T21:14:56+00:00 |
| Next Scan | 2026-05-02T21:14:56+00:00 |
Last Successful Scan
| Scanned | 2025-09-12T16:10:25+00:00 |
| URL | https://paleovalley.com/robots.txt |
| Domain IPs | 172.66.41.4, 172.66.42.252, 2606:4700:3108::ac42:2904, 2606:4700:3108::ac42:2afc |
| Response IP | 172.66.42.252 |
| Found | Yes |
| Hash | b1499f359919f98b6aee5bf06758277a1ee5f82b7b7b71864b98a7ab083e9667 |
| SimHash | 44f59c566514 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /offers/ |
| Allow | /store/ |
| Disallow | /billing/ |
| Disallow | /checkout-nd/ |
| Disallow | /secure/ |
| Disallow | /account/ |
| Disallow | /promo/ |
| Disallow | /checkout-nd/ |
| Disallow | /checkout/ |
| Disallow | /store/checkout-step-1 |
| Disallow | /store/checkout-step-2 |
| Disallow | /store/cart |
| Disallow | /store/order-complete/ |
| Disallow | /promos/ |
adsbot-google
| Rule | Path |
|---|---|
| Allow | /offers/ |
| Allow | /store/ |
| Disallow | /billing/ |
| Disallow | /checkout-nd/ |
| Disallow | /secure/ |
| Disallow | /account/ |
| Disallow | /promo/ |
| Disallow | /checkout-nd/ |
| Disallow | /checkout/ |
| Disallow | /store/checkout-step-1 |
| Disallow | /store/checkout-step-2 |
| Disallow | /store/cart |
| Disallow | /store/order-complete/ |
| Disallow | /promos/ |
googlebot-image
| Rule | Path |
|---|---|
| Allow | /offers/ |
| Allow | /store/ |
| Disallow | /billing/ |
| Disallow | /checkout-nd/ |
| Disallow | /secure/ |
| Disallow | /account/ |
| Disallow | /promo/ |
| Disallow | /checkout-nd/ |
| Disallow | /checkout/ |
| Disallow | /store/checkout-step-1 |
| Disallow | /store/checkout-step-2 |
| Disallow | /store/cart |
| Disallow | /store/order-complete/ |
| Disallow | /promos/ |
*
| Rule | Path |
|---|---|
| Disallow | /billing/ |
| Disallow | /checkout-nd/ |
| Disallow | /secure/ |
| Disallow | /account/ |
| Disallow | /promo/ |
| Disallow | /offers/ |
| Disallow | /promos/ |
Comments