scholar.nycu.edu.tw
robots.txt

Robots Exclusion Standard data for scholar.nycu.edu.tw

Resource Scan

Scan Details

Site Domain scholar.nycu.edu.tw
Base Domain nycu.edu.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/26/2025, 6:41:31 PM
Next Scan 5/25/2025, 6:41:31 PM

Last Successful Scan

Scanned1/3/2025, 6:40:11 PM
URL https://scholar.nycu.edu.tw/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 172.64.148.16
Found Yes
Hash 3c9c7fa25f4297ffa86bb1ac2c6630ae6faba1baf8f2ad21b8c091c238825ab6
SimHash 6b1d9860a133

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://scholar.nycu.edu.tw/sitemap.xml