hafele.nl
robots.txt
Robots Exclusion Standard data for hafele.nl
Resource Scan
Scan Details
Site Domain | hafele.nl |
Base Domain | hafele.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-09T18:01:48+00:00 |
Next Scan | 2024-12-08T18:01:48+00:00 |
Last Successful Scan
Scanned | 2024-04-20T17:41:25+00:00 |
URL | https://hafele.nl/robots.txt |
Redirect | https://www.hafele.nl/robots.txt |
Redirect Domain | www.hafele.nl |
Redirect Base | hafele.nl |
Domain IPs | 37.143.42.2 |
Redirect IPs | 108.156.133.22, 108.156.133.44, 108.156.133.61, 108.156.133.9 |
Response IP | 108.156.133.44 |
Found | Yes |
Hash | c297d94edd7b76fbce2c4f197690d9e1db5519d9e5bbbba96672a73301224b20 |
SimHash | 95865fc045b3 |
Groups
*
Rule | Path |
---|---|
Disallow | */WFS/ |
Allow | */WFS/*/images/ |
Allow | */WFS/*/documents/ |
Allow | */WFS/*/assets/ |
Allow | */WFS/*/bundles/ |
Allow | */WFS/*/js/ |
Allow | */WFS/*/css/ |
Disallow | */BOS/ |
Disallow | */account/ |
Disallow | */cart/ |
Disallow | */search/ |
Disallow | */compare/ |
Disallow | */WFS/*ViewParametricSearch-* |
Disallow | *ViewUserAccount* |
Disallow | *%26SearchType* |
Disallow | *?SearchParameter=* |
Disallow | *?app= |
Disallow | *?MasterSKU=* |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://www.hafele.nl/nl/sitemap.xml |
Comments