miels.nl
robots.txt
Robots Exclusion Standard data for miels.nl
Resource Scan
Scan Details
Site Domain | miels.nl |
Base Domain | miels.nl |
Scan Status | Ok |
Last Scan | 2024-10-04T09:17:19+00:00 |
Next Scan | 2024-10-11T09:17:19+00:00 |
Last Scan
Scanned | 2024-10-04T09:17:19+00:00 |
URL | https://miels.nl/robots.txt |
Domain IPs | 2a01:238:20a:202:1157::, 81.169.145.157 |
Response IP | 81.169.145.157 |
Found | Yes |
Hash | ffc5f6f3a7f02f1efa566f8b547c1b353a960ae60cf5fc24452be40c14bc95f0 |
SimHash | e1704b20cbf1 |
Groups
*
Rule | Path |
---|---|
Disallow | /dev/ |
Disallow | /assets/ |
Disallow | /cgi-bin/ |
Disallow | /errorcodes/ |
Disallow | /storage/ |
Disallow | /foto/ |