m.iex.nl
robots.txt

Robots Exclusion Standard data for m.iex.nl

Resource Scan

Scan Details

Site Domain m.iex.nl
Base Domain iex.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-24T10:26:18+00:00
Next Scan 2024-10-22T10:26:18+00:00

Last Successful Scan

Scanned2023-06-08T05:25:21+00:00
URL https://m.iex.nl/robots.txt
Redirect https://www.iex.nl/robots.txt
Redirect Domain www.iex.nl
Redirect Base iex.nl
Domain IPs 85.17.220.141
Redirect IPs 85.17.220.141
Response IP 85.17.220.141
Found Yes
Hash eb7ec71a3b33383b95647da45e05119c38007653c2638bebd3012889a0037997
SimHash 0904d2704710

Groups

mediapartners-google

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /marktplaats/order.aspx

Other Records

Field Value
crawl-delay 1