hafele.com.my
robots.txt

Robots Exclusion Standard data for hafele.com.my

Resource Scan

Scan Details

Site Domain hafele.com.my
Base Domain hafele.com.my
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T20:13:05+00:00
Next Scan 2024-12-06T20:13:05+00:00

Last Successful Scan

Scanned2024-04-18T18:48:30+00:00
URL https://hafele.com.my/robots.txt
Redirect https://www.hafele.com.my/robots.txt
Redirect Domain www.hafele.com.my
Redirect Base hafele.com.my
Domain IPs 37.143.42.2
Redirect IPs 108.156.133.20, 108.156.133.24, 108.156.133.3, 108.156.133.46
Response IP 108.156.133.24
Found Yes
Hash 06b82e818bbc2b3a9bff5c381e0e24a5a53cea421095a89cb5f92d684a1ea493
SimHash 9d845bc047b3

Groups

intershop webadapter agent

Rule Path
Allow /

*

Rule Path
Disallow */WFS/
Allow */WFS/*/images/
Allow */WFS/*/documents/
Allow */WFS/*/assets/
Allow */WFS/*/bundles/
Allow */WFS/*/js/
Allow */WFS/*/css/
Disallow */BOS/
Disallow */account/
Disallow */cart/
Disallow */search/
Disallow */compare/
Disallow */WFS/*ViewParametricSearch-*
Disallow *ViewUserAccount*
Disallow *%26SearchType*
Disallow *?SearchParameter=*
Disallow *?app=
Disallow *?MasterSKU=*
Disallow *.pdf

Other Records

Field Value
sitemap https://www.hafele.com.my/en/sitemap.xml

Comments

  • robots.txt