ntnu.no
robots.txt
Robots Exclusion Standard data for ntnu.no
Resource Scan
Scan Details
| Site Domain | ntnu.no |
| Base Domain | ntnu.no |
| Scan Status | Ok |
| Last Scan | 2024-11-03T03:46:51+00:00 |
| Next Scan | 2024-12-03T03:46:51+00:00 |
Last Scan
| Scanned | 2024-11-03T03:46:51+00:00 |
| URL | https://ntnu.no/robots.txt |
| Redirect | https://www.ntnu.no/robots.txt |
| Redirect Domain | www.ntnu.no |
| Redirect Base | ntnu.no |
| Domain IPs | 129.241.160.102, 2001:700:300:6::102 |
| Redirect IPs | 129.241.160.102, 2001:700:300:6::102 |
| Response IP | 129.241.160.102 |
| Found | Yes |
| Hash | 2485f7ca01ecbe350656324cdac388d986008ac6e87bc7ed3e14e2e3af97edaa |
| SimHash | 5e2f7a3a6a82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /c/portal/ |
| Disallow | /en/ |
| Disallow | /lib |
| Disallow | /nb/ |
| Disallow | /search |
| Disallow | /sok |
| Disallow | /sitemap.xml |
| Disallow | /tmp |
| Disallow | /web |
| Disallow | /ansatte/-/ |
| Disallow | /employees/-/ |
| Disallow | /combo/ |
| Disallow | /combo? |
| Disallow | /combo |
| Disallow | /nettbutikk/ |
| Disallow | /machform/ |
| Disallow | /adm/it/dokumenter |
| Disallow | /api/ |
| Disallow | /arch |
| Disallow | /bridge/bedrift/ |
| Disallow | /bridge/studentprofil/ |
| Disallow | /bridge/students |
| Disallow | /c14 |
| Disallow | /captain |
| Disallow | /diskusjon |
| Disallow | /gemini |
| Disallow | /group/ |
| Disallow | /ime/_detail |
| Disallow | /ime/_export |
| Disallow | /ime/_media |
| Disallow | /ime/lib |
| Disallow | /ime/statistikk |
| Disallow | /info/old/ |
| Disallow | /iteamax |
| Disallow | /mailinglists |
| Disallow | /ntnu-bil |
| Disallow | /offjour |
| Disallow | /okonomi |
| Disallow | /pics |
| Disallow | /proxy.pac |
| Disallow | /statistikk |
| Disallow | /studieavd |
| Disallow | /studieavd/dok |
| Disallow | /studieavd/timeplan/ |
| Disallow | /www-admin |
Comments