www.math.snu.ac.kr
robots.txt

Robots Exclusion Standard data for www.math.snu.ac.kr

Resource Scan

Scan Details

Site Domain www.math.snu.ac.kr
Base Domain snu.ac.kr
Scan Status Ok
Last Scan2024-10-21T10:29:37+00:00
Next Scan 2024-11-20T10:29:37+00:00

Last Scan

Scanned2024-10-21T10:29:37+00:00
URL http://www.math.snu.ac.kr/robots.txt
Domain IPs 147.46.27.70
Response IP 147.46.27.70
Found Yes
Hash 7ba9744cd9d505d24b1cdfba12deb9f0531c1617399ecabe24b1ed4c91b174e0
SimHash 981cd1137f30

Groups

*

Rule Path
Disallow /board/files
Disallow /data

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

ahrefsbo

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

headless

Rule Path
Disallow /

netestate

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

adsbot/3.1

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

googlebot

Rule Path
Allow /