marcus.dk
robots.txt

Robots Exclusion Standard data for marcus.dk

Resource Scan

Scan Details

Site Domain marcus.dk
Base Domain marcus.dk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-13T14:52:52+00:00
Next Scan 2025-09-12T14:52:52+00:00

Last Successful Scan

Scanned2025-06-21T08:02:09+00:00
URL https://marcus.dk/robots.txt
Redirect https://www.marcus.dk/robots.txt
Redirect Domain www.marcus.dk
Redirect Base marcus.dk
Domain IPs 86.48.72.41
Redirect IPs 86.48.72.41
Response IP 86.48.72.41
Found Yes
Hash 282abc8befe9c0c18841e45491eaeff3d56f49a8210fafd8fc81d66c2726ac61
SimHash bc555b744313

Groups

fasterfox

Rule Path
Disallow /

*

Rule Path
Disallow /cart
Disallow /kurv
Disallow /checkout
Disallow /search
Disallow /sog
Disallow /tell
Disallow /tip
Disallow /ask
Disallow /sporg
Disallow /websession
Disallow /share/