ntnu.no
robots.txt
Robots Exclusion Standard data for ntnu.no
Resource Scan
Scan Details
Site Domain | ntnu.no |
Base Domain | ntnu.no |
Scan Status | Ok |
Last Scan | 2024-06-04T21:58:25+00:00 |
Next Scan | 2024-07-04T21:58:25+00:00 |
Last Scan
Scanned | 2024-06-04T21:58:25+00:00 |
URL | https://ntnu.no/robots.txt |
Redirect | https://www.ntnu.no/robots.txt |
Redirect Domain | www.ntnu.no |
Redirect Base | ntnu.no |
Domain IPs | 129.241.160.102, 2001:700:300:6::102 |
Redirect IPs | 129.241.160.102, 2001:700:300:6::102 |
Response IP | 129.241.160.102 |
Found | Yes |
Hash | f7848388fea4c0bca2c4aab20019e38018fcb196b54220867b7914688fc89745 |
SimHash | 7f2f7a3a6ad2 |
Groups
*
Rule | Path |
---|---|
Disallow | /c/portal/ |
Disallow | /en/ |
Disallow | /lib |
Disallow | /nb/ |
Disallow | /search |
Disallow | /sok |
Disallow | /sitemap.xml |
Disallow | /tmp |
Disallow | /web |
Disallow | /ansatte/-/ |
Disallow | /employees/-/ |
Disallow | /combo/ |
Disallow | /combo? |
Disallow | /combo |
Disallow | /nettbutikk/ |
Disallow | /machform/ |
Disallow | /adm/it/dokumenter |
Disallow | /api/ |
Disallow | /arch |
Disallow | /backup |
Disallow | /bridge/bedrift/ |
Disallow | /bridge/studentprofil/ |
Disallow | /bridge/students |
Disallow | /c14 |
Disallow | /captain |
Disallow | /diskusjon |
Disallow | /dmf/offentlig-journal |
Disallow | /ept/booking/ |
Disallow | /gemini |
Disallow | /group/ |
Disallow | /guestbook |
Disallow | /ime/_detail |
Disallow | /ime/_export |
Disallow | /ime/_media |
Disallow | /ime/lib |
Disallow | /ime/statistikk |
Disallow | /info/old/ |
Disallow | /iteamax |
Disallow | /mailinglists |
Disallow | /ntnu-bil |
Disallow | /offjour |
Disallow | /okonomi |
Disallow | /pics |
Disallow | /proxy.pac |
Disallow | /statistikk |
Disallow | /studieavd |
Disallow | /studieavd/dok |
Disallow | /studieavd/timeplan/ |
Disallow | /www-admin |
Comments