ustad.nl
robots.txt
Robots Exclusion Standard data for ustad.nl
Resource Scan
Scan Details
Site Domain | ustad.nl |
Base Domain | ustad.nl |
Scan Status | Ok |
Last Scan | 2024-11-12T16:34:22+00:00 |
Next Scan | 2024-11-19T16:34:22+00:00 |
Last Scan
Scanned | 2024-11-12T16:34:22+00:00 |
URL | https://ustad.nl/robots.txt |
Redirect | https://www.ustad.nl/robots.txt |
Redirect Domain | www.ustad.nl |
Redirect Base | ustad.nl |
Domain IPs | 195.60.214.12 |
Redirect IPs | 2600:9000:23d0:1e00:1c:e2f:d440:93a1, 2600:9000:23d0:4600:1c:e2f:d440:93a1, 2600:9000:23d0:6400:1c:e2f:d440:93a1, 2600:9000:23d0:7200:1c:e2f:d440:93a1, 2600:9000:23d0:7800:1c:e2f:d440:93a1, 2600:9000:23d0:8400:1c:e2f:d440:93a1, 2600:9000:23d0:9e00:1c:e2f:d440:93a1, 2600:9000:23d0:e00:1c:e2f:d440:93a1, 65.9.112.106, 65.9.112.5, 65.9.112.57, 65.9.112.84 |
Response IP | 52.85.49.3 |
Found | Yes |
Hash | 212417d16e77d4866412b7afc1a95e68ff7f7e2762b69837d84778f09fcfff9b |
SimHash | 741309518402 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /content/ |
Disallow | /embedded/ |
Disallow | /data/ |
Disallow | /inc/ |
Disallow | /*/- |
Disallow | /nos/ |
Disallow | /zoeken?q=* |
Other Records
Field | Value |
---|---|
sitemap | https://ustad.undefined.egeniq.regiogroei.nl/sitemap/sitemap.xml.gz |