algdat.idi.ntnu.no
robots.txt

Robots Exclusion Standard data for algdat.idi.ntnu.no

Resource Scan

Scan Details

Site Domain algdat.idi.ntnu.no
Base Domain ntnu.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-21T22:24:46+00:00
Next Scan 2025-12-20T22:24:46+00:00

Last Successful Scan

Scanned2025-04-02T20:14:03+00:00
URL https://algdat.idi.ntnu.no/robots.txt
Domain IPs 129.241.106.95
Response IP 129.241.106.95
Found Yes
Hash a80389f5f1ed3e1714a804289372529e0a0d8280d4b9e69fd9e767919fc67af5
SimHash c84089626f90

Groups

googlebot

Rule Path
Allow /forum/
Disallow /forum/uploads/*

*

Rule Path
Disallow /forum/