douglas.de
robots.txt
Robots Exclusion Standard data for douglas.de
Resource Scan
Scan Details
Site Domain | douglas.de |
Base Domain | douglas.de |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-21T11:46:54+00:00 |
Next Scan | 2024-12-20T11:46:54+00:00 |
Last Successful Scan
Scanned | 2024-05-18T08:42:59+00:00 |
URL | https://douglas.de/robots.txt |
Redirect | https://www.douglas.de/robots.txt |
Redirect Domain | www.douglas.de |
Redirect Base | douglas.de |
Domain IPs | 40.114.191.163 |
Redirect IPs | 23.53.217.137, 2600:1413:b000:389::2854, 2600:1413:b000:38e::2854 |
Response IP | 96.16.117.42 |
Found | Yes |
Hash | 385b895b8fe6d8de8934745b23afa0ec9ef65a3a5aa69cc4d262ac4a0a6de3ad |
SimHash | ed9998348d98 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /cart |
Disallow | /checkout |
Disallow | /error |
Disallow | /datafeed/* |
Disallow | /wishlist |
Disallow | /search.html* |
Disallow | /search* |
Disallow | /*?q=* |
Disallow | /*?bvstate=* |
Disallow | /*?sourceRef=* |
Disallow | /*?nomobile=true* |
Disallow | /*?sortAsc=* |
Disallow | /*?rdeTemplate=* |
Disallow | /*?sortField=* |
Disallow | /de/b/*/b*_28 |
Disallow | /de/b/*/b*_84 |
Disallow | /de/b/*/b*_8411 |
Disallow | /de/b/*/b*_27 |
Disallow | /de/b/*/b*_2705 |
Disallow | /de/b/*/b*_2701 |
Disallow | /de/b/*/b*_86 |
Disallow | /de/b/*/b*_8604 |
Disallow | /de/b/*/b*_44 |
Disallow | /de/b/*/b*_4401 |
Disallow | /de/b/*/b*_440104 |
Disallow | /de/b/*/b*_4402 |
Disallow | /de/b/*/b*_440204 |
Disallow | /de/b/*/b*_56 |
Disallow | /de/b/*/b*_83 |
Disallow | /de/b/*/b*_24 |
Disallow | /de/b/*/b*_2401 |
Disallow | /de/b/*/b*_2413 |
Disallow | /de/b/*/b*_240101 |
Disallow | /de/b/*/b*_240102 |
Disallow | /de/b/*/b*_240105 |
Disallow | /de/b/*/b*_2403 |
Disallow | /de/b/*/b*_240304 |
Disallow | /de/b/*/b*_2402 |
Disallow | /de/b/*/b*_240205 |
Disallow | /de/b/*/b*_2412 |
Disallow | /de/b/*/b*_65 |
Disallow | /de/b/*/b*_82 |
Disallow | /de/b/*/b*_8204 |
Disallow | /de/b/*/b*_94 |
Disallow | /de/b/*/b*_35 |
Disallow | /de/b/*/b*_6501 |
Disallow | /de/b/*/b*_6502 |
Disallow | /de/c/douglas-health-magazine/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.douglas.de/api/v2/de_DE_dgl/sitemap/sitemap.xml |
sitemap | https://www.douglas.de/211116-id-99-sitemap-de.xml |