hafele.co.nz
robots.txt

Robots Exclusion Standard data for hafele.co.nz

Resource Scan

Scan Details

Site Domain hafele.co.nz
Base Domain hafele.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-20T00:40:32+00:00
Next Scan 2024-07-19T00:40:32+00:00

Last Successful Scan

Scanned2024-02-27T15:49:14+00:00
URL https://hafele.co.nz/robots.txt
Redirect https://www.hafele.co.nz/robots.txt
Redirect Domain www.hafele.co.nz
Redirect Base hafele.co.nz
Domain IPs 37.143.42.2
Redirect IPs 108.157.254.110, 108.157.254.3, 108.157.254.63, 108.157.254.78
Response IP 108.157.254.63
Found Yes
Hash e8ae753a414b6deeb42ab9a75ae3ecfed3e6a9224fd464dca5ad5546e49b4891
SimHash 9d865bc057f7

Groups

intershop webadapter agent

Rule Path
Allow /

*

Rule Path
Disallow */WFS/
Allow */WFS/*/images/
Allow */WFS/*/documents/
Allow */WFS/*/assets/
Allow */WFS/*/bundles/
Allow */WFS/*/js/
Allow */WFS/*/css/
Disallow */BOS/
Disallow */account/
Disallow */cart/
Disallow */search/
Disallow */compare/
Disallow */WFS/*ViewParametricSearch-*
Disallow *ViewUserAccount*
Disallow *%26SearchType*
Disallow *?SearchParameter=*
Disallow *?app=
Disallow *?MasterSKU=*
Disallow *.pdf

Other Records

Field Value
sitemap https://www.hafele.co.nz/en/sitemap.xml

Comments

  • robots.txt