oost.nl
robots.txt
Robots Exclusion Standard data for oost.nl
Resource Scan
Scan Details
Site Domain | oost.nl |
Base Domain | oost.nl |
Scan Status | Ok |
Last Scan | 2024-09-19T10:34:08+00:00 |
Next Scan | 2024-09-26T10:34:08+00:00 |
Last Scan
Scanned | 2024-09-19T10:34:08+00:00 |
URL | https://oost.nl/robots.txt |
Redirect | https://www.oost.nl/robots.txt |
Redirect Domain | www.oost.nl |
Redirect Base | oost.nl |
Domain IPs | 62.165.73.20 |
Redirect IPs | 2600:9000:2156:2e00:13:781e:4740:93a1, 2600:9000:2156:4c00:13:781e:4740:93a1, 2600:9000:2156:8a00:13:781e:4740:93a1, 2600:9000:2156:8e00:13:781e:4740:93a1, 2600:9000:2156:ba00:13:781e:4740:93a1, 2600:9000:2156:c800:13:781e:4740:93a1, 2600:9000:2156:d000:13:781e:4740:93a1, 2600:9000:2156:d400:13:781e:4740:93a1, 65.9.112.110, 65.9.112.69, 65.9.112.8, 65.9.112.86 |
Response IP | 18.165.140.7 |
Found | Yes |
Hash | def6914d745cb25d1a606ef238ad5427db439d6baafcb90a9459956432823032 |
SimHash | 701b19518601 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /content/ |
Disallow | /embedded/ |
Disallow | /data/ |
Disallow | /inc/ |
Disallow | /*/- |
Disallow | /nos/ |
Disallow | /zoeken?q=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.oost.nl/sitemap/sitemap.xml.gz |