portal.findresearcher.sdu.dk
robots.txt

Robots Exclusion Standard data for portal.findresearcher.sdu.dk

Resource Scan

Scan Details

Site Domain portal.findresearcher.sdu.dk
Base Domain sdu.dk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-25T22:05:33+00:00
Next Scan 2025-05-24T22:05:33+00:00

Last Successful Scan

Scanned2025-01-02T22:04:33+00:00
URL https://portal.findresearcher.sdu.dk/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 104.18.39.240
Found Yes
Hash b0121f37f7aaea8be1deca46ec880101d91ba70065a7e9f80675c8957ee95d27
SimHash e91d9830e173

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://portal.findresearcher.sdu.dk/sitemap.xml