stedelijk.nl
robots.txt

Robots Exclusion Standard data for stedelijk.nl

Resource Scan

Scan Details

Site Domain stedelijk.nl
Base Domain stedelijk.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-22T06:48:00+00:00
Next Scan 2024-05-22T06:48:00+00:00

Last Successful Scan

Scanned2023-11-10T04:53:13+00:00
URL https://stedelijk.nl/robots.txt
Redirect https://www.stedelijk.nl/robots.txt
Redirect Domain www.stedelijk.nl
Redirect Base stedelijk.nl
Domain IPs 34.242.101.40, 34.252.243.11
Redirect IPs 2600:9000:269b:3600:1c:a449:2500:93a1, 2600:9000:269b:5400:1c:a449:2500:93a1, 2600:9000:269b:5600:1c:a449:2500:93a1, 2600:9000:269b:7000:1c:a449:2500:93a1, 2600:9000:269b:7c00:1c:a449:2500:93a1, 2600:9000:269b:8600:1c:a449:2500:93a1, 2600:9000:269b:9c00:1c:a449:2500:93a1, 2600:9000:269b:fa00:1c:a449:2500:93a1, 3.160.196.103, 3.160.196.68, 3.160.196.78, 3.160.196.94
Response IP 18.239.83.10
Found Yes
Hash 81eb5765594c3541e3fdf1392b5af5d819519c94ef0da101de0de567a3907c63
SimHash a1488702643d

Groups

*

Rule Path
Allow *

Warnings

  • 10 invalid lines.