Log In Sign Up

www.duo.uio.no
robots.txt

Robots Exclusion Standard data for www.duo.uio.no

Resource Scan

Scan Details

Site Domain www.duo.uio.no
Base Domain uio.no
Scan Status Ok
Last Scan2025-05-18T15:28:29+00:00
Next Scan 2025-06-01T15:28:29+00:00

Last Scan

Scanned2025-05-18T15:28:29+00:00
URL https://www.duo.uio.no/robots.txt
Domain IPs 129.240.118.41
Response IP 129.240.118.41
Found Yes
Hash 3d5e1a9664eddc2cfa4034ff227d030f7ad6b5d3d95471d4cb34a9c53f28707f
SimHash 783d0db5655c

Groups

*

Rule Path
Disallow /discover
Disallow /search-filter
Back to top

Comments

  • Uncomment the following line ONLY if sitemaps.org or HTML sitemaps are used
  • and you have verified that your site is being indexed correctly.
  • Disallow: /browse
  • You also may wish to disallow access to the following paths, in order
  • to stop web spiders from accessing user-based content:
  • Disallow: /advanced-search
  • Disallow: /contact
  • Disallow: /feedback
  • Disallow: /forgot
  • Disallow: /login
  • Disallow: /register
  • Disallow: /search
Back to top