strommen.dk
robots.txt

Robots Exclusion Standard data for strommen.dk

Resource Scan

Scan Details

Site Domain strommen.dk
Base Domain strommen.dk
Scan Status Ok
Last Scan2026-03-05T05:39:58+00:00
Next Scan 2026-04-04T05:39:58+00:00

Last Scan

Scanned2026-03-05T05:39:58+00:00
URL https://strommen.dk/robots.txt
Domain IPs 94.231.106.103
Response IP 94.231.106.103
Found Yes
Hash 602f0eb396e872455d7e51d99df7fdd1ab09e615b969dfacedf0c8ae4044efab
SimHash 4e14dc85e710

Groups

*

Rule Path
Disallow /shop/?filtering=1&filter_product_brand=*%2C*

Other Records

Field Value
crawl-delay 3

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10