m.iex.nl
robots.txt
Robots Exclusion Standard data for m.iex.nl
Resource Scan
Scan Details
Site Domain | m.iex.nl |
Base Domain | iex.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-07-24T10:26:18+00:00 |
Next Scan | 2024-10-22T10:26:18+00:00 |
Last Successful Scan
Scanned | 2023-06-08T05:25:21+00:00 |
URL | https://m.iex.nl/robots.txt |
Redirect | https://www.iex.nl/robots.txt |
Redirect Domain | www.iex.nl |
Redirect Base | iex.nl |
Domain IPs | 85.17.220.141 |
Redirect IPs | 85.17.220.141 |
Response IP | 85.17.220.141 |
Found | Yes |
Hash | eb7ec71a3b33383b95647da45e05119c38007653c2638bebd3012889a0037997 |
SimHash | 0904d2704710 |
Groups
*
Rule | Path |
---|---|
Disallow | /marktplaats/order.aspx |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |