energievergelijken.nl
robots.txt
Robots Exclusion Standard data for energievergelijken.nl
Resource Scan
Scan Details
Site Domain | energievergelijken.nl |
Base Domain | energievergelijken.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T03:31:34+00:00 |
Next Scan | 2024-12-16T03:31:34+00:00 |
Last Successful Scan
Scanned | 2023-11-26T21:47:19+00:00 |
URL | https://www.energievergelijken.nl/robots.txt |
Domain IPs | 13.107.213.59, 13.107.246.59, 2620:1ec:46::57, 2620:1ec:bdf::57 |
Response IP | 13.107.213.59 |
Found | Yes |
Hash | 67b518af38dfa2b56389854268a848bd1cf0d6666172b24a8bdd4fd1d860e27e |
SimHash | 12186d6088b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /lp/ |
Disallow | /accounts |
Disallow | /iframes |
Disallow | /login_register |
Disallow | /login.aspx |
Disallow | /purchase/ |
Disallow | /rdr |
Disallow | /vergelijken/index |
Warnings
- 4 invalid lines.
Comments