melkweg.nl
robots.txt

Robots Exclusion Standard data for melkweg.nl

Resource Scan

Scan Details

Site Domain melkweg.nl
Base Domain melkweg.nl
Scan Status Ok
Last Scan2026-02-11T19:31:21+00:00
Next Scan 2026-03-13T19:31:21+00:00

Last Scan

Scanned2026-02-11T19:31:21+00:00
URL https://melkweg.nl/robots.txt
Redirect https://www.melkweg.nl/robots.txt
Redirect Domain www.melkweg.nl
Redirect Base melkweg.nl
Domain IPs 18.202.96.220, 34.247.202.247
Redirect IPs 2600:9000:2894:3e00:5:6b4b:6b80:93a1, 2600:9000:2894:5400:5:6b4b:6b80:93a1, 2600:9000:2894:7600:5:6b4b:6b80:93a1, 2600:9000:2894:a800:5:6b4b:6b80:93a1, 2600:9000:2894:b800:5:6b4b:6b80:93a1, 2600:9000:2894:cc00:5:6b4b:6b80:93a1, 2600:9000:2894:d000:5:6b4b:6b80:93a1, 2600:9000:2894:e800:5:6b4b:6b80:93a1, 3.170.229.103, 3.170.229.110, 3.170.229.47, 3.170.229.69
Response IP 3.170.229.47
Found Yes
Hash 0b1919f1241df9c0ace1c519c55ef084ef95398c2fd462bfc32d81cae6c420dd
SimHash 4d448a5184b3

Groups

*

Rule Path
Allow /
Disallow /pagina-niet-gevonden
Disallow /page-not-found

Other Records

Field Value
sitemap https://www.melkweg.nl/sitemap.xml
sitemap https://www.melkweg.nl/sitemap-0.xml
sitemap https://www.melkweg.nl/server-sitemap-index.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.