hafele.com.mx
robots.txt

Robots Exclusion Standard data for hafele.com.mx

Resource Scan

Scan Details

Site Domain hafele.com.mx
Base Domain hafele.com.mx
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-10T05:49:29+00:00
Next Scan 2024-07-10T05:49:29+00:00

Last Successful Scan

Scanned2024-04-19T05:48:51+00:00
URL https://hafele.com.mx/robots.txt
Redirect https://www.hafele.com.mx/robots.txt
Redirect Domain www.hafele.com.mx
Redirect Base hafele.com.mx
Domain IPs 37.143.42.2
Redirect IPs 13.33.88.116, 13.33.88.13, 13.33.88.18, 13.33.88.27
Response IP 13.33.88.27
Found Yes
Hash 2996f0d27ee5b57fdd3e0d0f68952baa4d19fc87963fe8b3bf9e460a9f601d91
SimHash 95825fc055f7

Groups

intershop webadapter agent

Rule Path
Allow /

*

Rule Path
Disallow */WFS/
Allow */WFS/*/images/
Allow */WFS/*/documents/
Allow */WFS/*/assets/
Allow */WFS/*/bundles/
Allow */WFS/*/js/
Allow */WFS/*/css/
Disallow */BOS/
Disallow */account/
Disallow */cart/
Disallow */search/
Disallow */compare/
Disallow */WFS/*ViewParametricSearch-*
Disallow *ViewUserAccount*
Disallow *%26SearchType*
Disallow *?SearchParameter=*
Disallow *?app=
Disallow *?MasterSKU=*
Disallow *.pdf

Other Records

Field Value
sitemap https://www.hafele.com.mx/es/sitemap.xml

Comments

  • robots.txt