decoclean.de
robots.txt

Robots Exclusion Standard data for decoclean.de

Resource Scan

Scan Details

Site Domain decoclean.de
Base Domain decoclean.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-30T22:37:55+00:00
Next Scan 2026-03-30T22:37:55+00:00

Last Successful Scan

Scanned2025-05-12T18:55:26+00:00
URL https://decoclean.de/robots.txt
Domain IPs 193.41.237.96
Response IP 193.41.237.96
Found Yes
Hash d8be771c6f29c4e6cdb0593309ebeacdfde9a516547640883469ada4923ca86b
SimHash ed0edc22e313

Groups

*

Rule Path
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow */?filter*
Disallow /katalog/?product_cat*
Disallow /katalog/?source_id*

Other Records

Field Value
crawl-delay 20

blexbot

Rule Path
Disallow */?filter*

Other Records

Field Value
crawl-delay 20

semrushbot

Rule Path
Disallow */?filter*

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow */?filter*

Other Records

Field Value
crawl-delay 10

megaindex

Rule Path
Disallow */?filter*

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow */?filter*

Other Records

Field Value
crawl-delay 20

molokaibot

Rule Path
Disallow */?product_view=list*

Other Records

Field Value
crawl-delay 20