cdu.no
robots.txt
Robots Exclusion Standard data for cdu.no
Resource Scan
Scan Details
| Site Domain | cdu.no |
| Base Domain | cdu.no |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Error encountered. |
| Last Scan | 2025-10-01T16:36:14+00:00 |
| Next Scan | 2025-10-31T16:36:14+00:00 |
Last Successful Scan
| Scanned | 2025-08-10T11:48:41+00:00 |
| URL | https://cdu.no/robots.txt |
| Redirect | https://utdanning.cappelendamm.no/robots.txt |
| Redirect Domain | utdanning.cappelendamm.no |
| Redirect Base | cappelendamm.no |
| Domain IPs | 137.221.28.94 |
| Redirect IPs | 104.18.30.209, 104.18.31.209, 2606:4700::6812:1ed1, 2606:4700::6812:1fd1 |
| Response IP | 104.18.30.209 |
| Found | Yes |
| Hash | 0c2520302a3818e39f26cc06301e21f18ac78297e1192f78d60af96a2dae82bc |
| SimHash | 88005e554d93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sok |
| Disallow | /ordre* |
| Disallow | /boker/barneboker/musse-og-helium-for-pedagoger |
Other Records
| Field | Value |
|---|---|
| sitemap | https://utdanning.cappelendamm.no/portal-api/noauth/sitemap/sitemaps.xml |