bilka.dk
robots.txt
Robots Exclusion Standard data for bilka.dk
Resource Scan
Scan Details
Site Domain | bilka.dk |
Base Domain | bilka.dk |
Scan Status | Ok |
Last Scan | 2024-05-27T17:35:23+00:00 |
Next Scan | 2024-06-26T17:35:23+00:00 |
Last Scan
Scanned | 2024-05-27T17:35:23+00:00 |
URL | https://bilka.dk/robots.txt |
Redirect | https://www.bilka.dk/robots.txt |
Redirect Domain | www.bilka.dk |
Redirect Base | bilka.dk |
Domain IPs | 75.2.60.5 |
Redirect IPs | 13.215.31.72, 175.41.180.202, 2406:da14:ef6:8500::1f4, 2406:da14:ef6:8502::1f4 |
Response IP | 13.215.246.123 |
Found | Yes |
Hash | f03addda99a00c66a8d7cb68e9f6f8c48e7f7eec48abdb63daa86c43c0613a6b |
SimHash | 75550746e4d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /kurv |
Disallow | /cookies |
Disallow | /checkout |
Disallow | /wishlist |
Disallow | /search |
Disallow | /kvittering |
Disallow | /signin |
Disallow | /account |
Disallow | /update-browser |
Disallow | /storetablet/* |
Disallow | */content* |
Disallow | */plp-main* |
Disallow | */plp-top* |
Disallow | */plp-bottom* |
Disallow | /bilka-plus-partn3rford3le75902xyj/ |
Other Records
Field | Value |
---|---|
sitemap | https://bilka.dk/sitemap/sitemap-index.xml |