researchportal.helsinki.fi
robots.txt

Robots Exclusion Standard data for researchportal.helsinki.fi

Resource Scan

Scan Details

Site Domain researchportal.helsinki.fi
Base Domain helsinki.fi
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-25T15:50:49+00:00
Next Scan 2025-05-24T15:50:49+00:00

Last Successful Scan

Scanned2025-01-02T15:42:01+00:00
URL https://researchportal.helsinki.fi/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 172.64.148.16
Found Yes
Hash d359e036d8efed4cd95e589564724fd697f5eb02ef6c554df9bdf781ab46a43f
SimHash 6d1c1830e133

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://researchportal.helsinki.fi/sitemap.xml