dlg.dk
robots.txt
Robots Exclusion Standard data for dlg.dk
Resource Scan
Scan Details
| Site Domain | dlg.dk |
| Base Domain | dlg.dk |
| Scan Status | Ok |
| Last Scan | 2024-10-08T05:49:17+00:00 |
| Next Scan | 2024-10-22T05:49:17+00:00 |
Last Scan
| Scanned | 2024-10-08T05:49:17+00:00 |
| URL | https://dlg.dk/robots.txt |
| Redirect | https://www.dlg.dk/robots.txt |
| Redirect Domain | www.dlg.dk |
| Redirect Base | dlg.dk |
| Domain IPs | 13.69.68.16 |
| Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | bcf6d78bea417f9dda5273641a0cd5598bd8386a5824fb0edb4a962537dcc525 |
| SimHash | 81351d228782 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sitecore/ |
| Disallow | /da/catalog* |
| Disallow | /da/basket* |
| Disallow | /da/search* |
| Disallow | /da/articles/spoergsmaal* |
| Disallow | /paymentsuccess* |
| Disallow | /PaymentSuccess* |
| Disallow | /da/paymentsuccess* |
| Disallow | /da/PaymentSuccess* |
| Disallow | /PasswordRecover |
| Disallow | /PasswordRecovery |
| Disallow | /*?searchquery |
| Disallow | */Search |
| Disallow | /*?location |
| Disallow | /*?person |
| Disallow | /*?loginrequired |
| Disallow | /*?tab |
| Disallow | *?area |
| Disallow | /products/0* |
| Disallow | /products/1* |
| Disallow | /products/2* |
| Disallow | /products/3* |
| Disallow | /products/4* |
| Disallow | /products/5* |
| Disallow | /products/6* |
| Disallow | /products/7* |
| Disallow | /products/8* |
| Disallow | /products/9* |