cr.org
robots.txt
Robots Exclusion Standard data for cr.org
Resource Scan
Scan Details
| Site Domain | cr.org |
| Base Domain | cr.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-31T21:40:36+00:00 |
| Next Scan | 2025-10-29T21:40:36+00:00 |
Last Successful Scan
| Scanned | 2024-06-30T15:13:42+00:00 |
| URL | https://cr.org/robots.txt |
| Redirect | https://www.consumerreports.org/robots.txt |
| Redirect Domain | www.consumerreports.org |
| Redirect Base | consumerreports.org |
| Domain IPs | 99.84.238.101, 99.84.238.179, 99.84.238.190, 99.84.238.217 |
| Redirect IPs | 99.84.238.101, 99.84.238.179, 99.84.238.190, 99.84.238.217 |
| Response IP | 99.84.238.190 |
| Found | Yes |
| Hash | a11b8fc4f14f1b85083045f4843ac4a95053a30faf024050a47b6742ad31a6d9 |
| SimHash | eb3ad861af13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /access |
| Disallow | /cro/search.htm |
| Disallow | /search* |
| Disallow | /health/search.htm |
| Disallow | /content/dam/cro/interactive/PRO410_Sept%20Premium.pdf |
| Disallow | /bin/home/calendar/ |
| Disallow | /*jcr%3Acontent* |
| Disallow | /*preview_print.html$ |
| Disallow | /*.print.html$ |
| Disallow | /data/* |
| Disallow | /bin/feedinfo.name%3Drss.xml |
| Disallow | /*?*page= |
| Disallow | /*?*sort= |
| Disallow | /*?*view= |