douglas.nl
robots.txt
Robots Exclusion Standard data for douglas.nl
Resource Scan
Scan Details
| Site Domain | douglas.nl |
| Base Domain | douglas.nl |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-06-09T07:50:44+00:00 |
| Next Scan | 2024-06-23T07:50:44+00:00 |
Last Successful Scan
| Scanned | 2024-05-18T07:50:12+00:00 |
| URL | https://douglas.nl/robots.txt |
| Redirect | https://www.douglas.nl/robots.txt |
| Redirect Domain | www.douglas.nl |
| Redirect Base | douglas.nl |
| Domain IPs | 40.114.191.163 |
| Redirect IPs | 23.53.217.137, 2600:1413:b000:389::2854, 2600:1413:b000:38e::2854 |
| Response IP | 96.16.117.42 |
| Found | Yes |
| Hash | 1f60c01f672ad5fbfe8a6ff6b4597ed265cb03f453045b9b0577fba5070e339b |
| SimHash | 65119b16cbb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /error |
| Disallow | /datafeed/* |
| Disallow | /wishlist |
| Disallow | /search.html* |
| Disallow | /search* |
| Disallow | /*?q=* |
| Disallow | /*?bvstate=* |
| Disallow | /*?sourceRef=* |
| Disallow | /*?nomobile=true* |
| Disallow | /*?page=* |
| Disallow | /*?sortAsc=* |
| Disallow | /*?rdeTemplate=* |
| Disallow | /*?sortField=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.douglas.nl/api/v2/nl_NL_dgl/sitemap/sitemap.xml |