devcms.yonsei.ac.kr
robots.txt

Robots Exclusion Standard data for devcms.yonsei.ac.kr

Resource Scan

Scan Details

Site Domain devcms.yonsei.ac.kr
Base Domain yonsei.ac.kr
Scan Status Ok
Last Scan2025-07-17T09:36:43+00:00
Next Scan 2025-08-16T09:36:43+00:00

Last Scan

Scanned2025-07-17T09:36:43+00:00
URL https://devcms.yonsei.ac.kr/robots.txt
Domain IPs 165.132.13.47
Response IP 165.132.13.47
Found Yes
Hash ad23bffb11dd351addf07ae51db3ae9b43f5b7d921b762befd531c17c0844615
SimHash e21cc080f012

Groups

*
*

Rule Path
Disallow /ics/admin
Disallow /ics_en
Disallow /board01
Disallow /_attach/
Disallow /_custom/
Disallow /_res/

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

viberbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

bytespider
bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://devcms.yonsei.ac.kr/sitemap_index.xml