hafele.nl
robots.txt

Robots Exclusion Standard data for hafele.nl

Resource Scan

Scan Details

Site Domain hafele.nl
Base Domain hafele.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T18:01:48+00:00
Next Scan 2024-12-08T18:01:48+00:00

Last Successful Scan

Scanned2024-04-20T17:41:25+00:00
URL https://hafele.nl/robots.txt
Redirect https://www.hafele.nl/robots.txt
Redirect Domain www.hafele.nl
Redirect Base hafele.nl
Domain IPs 37.143.42.2
Redirect IPs 108.156.133.22, 108.156.133.44, 108.156.133.61, 108.156.133.9
Response IP 108.156.133.44
Found Yes
Hash c297d94edd7b76fbce2c4f197690d9e1db5519d9e5bbbba96672a73301224b20
SimHash 95865fc045b3

Groups

intershop webadapter agent

Rule Path
Allow /

*

Rule Path
Disallow */WFS/
Allow */WFS/*/images/
Allow */WFS/*/documents/
Allow */WFS/*/assets/
Allow */WFS/*/bundles/
Allow */WFS/*/js/
Allow */WFS/*/css/
Disallow */BOS/
Disallow */account/
Disallow */cart/
Disallow */search/
Disallow */compare/
Disallow */WFS/*ViewParametricSearch-*
Disallow *ViewUserAccount*
Disallow *%26SearchType*
Disallow *?SearchParameter=*
Disallow *?app=
Disallow *?MasterSKU=*
Disallow *.pdf

Other Records

Field Value
sitemap https://www.hafele.nl/nl/sitemap.xml

Comments

  • robots.txt