shop.rewe.de
robots.txt
Robots Exclusion Standard data for shop.rewe.de
Resource Scan
Scan Details
| Site Domain | shop.rewe.de |
| Base Domain | rewe.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-12T00:41:24+00:00 |
| Next Scan | 2026-03-12T00:41:24+00:00 |
Last Successful Scan
| Scanned | 2025-07-31T03:21:05+00:00 |
| URL | https://shop.rewe.de/robots.txt |
| Domain IPs | 104.16.64.9, 104.16.65.9, 2606:4700::6810:4009, 2606:4700::6810:4109 |
| Response IP | 104.16.65.9 |
| Found | Yes |
| Hash | 093a9b2631bbc321b0efa52719db62ed8d807d4d8f9507f7c3556bda850b27e7 |
| SimHash | 21410f77c97e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mc/ |
| Disallow | /checkout/ |
| Disallow | /*%3Bjsessionid |
| Allow | /*?search=campaignKeyword |
| Disallow | /*?search= |
| Disallow | /*%26search%3D |
| Disallow | /*?merchantType= |
| Disallow | /*%26merchantType%3D |
| Disallow | /*?merchant= |
| Disallow | /*%26merchant%3D |
| Disallow | /*?objectsPerPage= |
| Disallow | /*%26objectsPerPage%3D |
| Disallow | /*?sorting= |
| Disallow | /*%26sorting%3D |
| Disallow | /doiretry |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shop.rewe.de/sitemaps/sitemap.xml |