rau-cosmetics.de
robots.txt
Robots Exclusion Standard data for rau-cosmetics.de
Resource Scan
Scan Details
| Site Domain | rau-cosmetics.de |
| Base Domain | rau-cosmetics.de |
| Scan Status | Ok |
| Last Scan | 2024-06-15T11:59:27+00:00 |
| Next Scan | 2024-07-15T11:59:27+00:00 |
Last Scan
| Scanned | 2024-06-15T11:59:27+00:00 |
| URL | https://rau-cosmetics.de/robots.txt |
| Domain IPs | 104.26.12.53, 104.26.13.53, 172.67.71.16, 2606:4700:20::681a:c35, 2606:4700:20::681a:d35, 2606:4700:20::ac43:4710 |
| Response IP | 104.26.13.53 |
| Found | Yes |
| Hash | 181cb6d62e2e553ba01369943b695944468e1e41b016d377d82498d1c7262d57 |
| SimHash | 491c4296c933 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */? |
| Disallow | */account/ |
| Disallow | */checkout/ |
| Disallow | */widgets/ |
| Disallow | */navigation/ |
| Disallow | */bundles/ |
| Disallow | */impressum$ |
| Disallow | */datenschutz$ |
| Disallow | */agb$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rau-cosmetics.de/sitemap.xml |