studies.helsinki.fi
robots.txt

Robots Exclusion Standard data for studies.helsinki.fi

Resource Scan

Scan Details

Site Domain studies.helsinki.fi
Base Domain helsinki.fi
Scan Status Ok
Last Scan2025-04-02T14:07:26+00:00
Next Scan 2025-05-02T14:07:26+00:00

Last Scan

Scanned2025-04-02T14:07:26+00:00
URL https://studies.helsinki.fi/robots.txt
Domain IPs 128.214.48.4
Response IP 128.214.48.4
Found Yes
Hash 8641737e47a360a7144ea4c240428143861c796e15e5f5ff41cfc55e2e4a5d80
SimHash 29004a52ce12

Groups

petalbot

Rule Path
Disallow /Shibboleth.sso/
Disallow /api/
Disallow /auth/
Disallow /config/
Disallow /obar-config

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://studies.helsinki.fi/sitemap.xml