postech.ac.kr
robots.txt

Robots Exclusion Standard data for postech.ac.kr

Resource Scan

Scan Details

Site Domain postech.ac.kr
Base Domain postech.ac.kr
Scan Status Ok
Last Scan2025-06-23T20:51:52+00:00
Next Scan 2025-07-23T20:51:52+00:00

Last Scan

Scanned2025-06-23T20:51:52+00:00
URL https://postech.ac.kr/robots.txt
Domain IPs 141.223.5.166
Response IP 141.223.5.166
Found Yes
Hash e2a9c30cb8075cdb86ddaee2cebbc963de16fb465343a38fc4f2efb29816f398
SimHash c20cc560f542

Groups

*
*

Rule Path
Disallow /_fox
Disallow /api/
Disallow /contentreport/
Disallow /temp01/
Disallow /temp02/
Disallow /temp03/
Disallow /kor/search.do
Disallow /search/front/Search.jsp
Disallow /eng/search.do
Disallow /search/front_en/Search.jsp
Disallow /search/mTool/common/
Disallow /kor/university-introduction/regulations_manual.do
Disallow /_attach/
Disallow /_custom/
Disallow /_res/

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

viberbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

bytespider
bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /