htu.no
robots.txt

Robots Exclusion Standard data for htu.no

Resource Scan

Scan Details

Site Domain htu.no
Base Domain htu.no
Scan Status Ok
Last Scan2024-09-18T10:18:58+00:00
Next Scan 2024-10-18T10:18:58+00:00

Last Scan

Scanned2024-09-18T10:18:58+00:00
URL https://htu.no/robots.txt
Redirect https://www.htu.no/robots.txt
Redirect Domain www.htu.no
Redirect Base htu.no
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.22, 76.76.21.98
Response IP 76.76.21.164
Found Yes
Hash fe3d46237dcfc1fe28111ecfacd0723da4c3cae0b2e0b5cb7e5fdee38dbbd056
SimHash 70080043c7b7

Groups

*

Rule Path
Allow /*
Disallow /api/*

Other Records

Field Value
sitemap https://www.htu.no/sitemap