m.oliveyoung.co.kr
robots.txt

Robots Exclusion Standard data for m.oliveyoung.co.kr

Resource Scan

Scan Details

Site Domain m.oliveyoung.co.kr
Base Domain oliveyoung.co.kr
Scan Status Ok
Last Scan2024-09-21T14:17:24+00:00
Next Scan 2024-10-05T14:17:24+00:00

Last Scan

Scanned2024-09-21T14:17:24+00:00
URL https://m.oliveyoung.co.kr/robots.txt
Domain IPs 13.227.254.111, 13.227.254.12, 13.227.254.124, 13.227.254.43
Response IP 13.227.254.124
Found Yes
Hash 49f989e1144962dbdf8fefaf5f8d6e911eb36d9be2592ba8823b183c2f9985df
SimHash f224cd4486f9

Groups

*

Rule Path
Disallow /
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

googlebot

Rule Path
Allow /m/main
Allow /m/search
Allow /m/giftCardGuide
Allow /m/planshop
Allow /m/display
Allow /m/event
Allow /m/vote
Allow /m/amusement
Allow /m/specialGdas
Allow /m/mypage
Allow /m/store
Allow /m/cart
Allow /m/goods
Allow /m/login
Allow /m/myGiftCard
Allow /m/counsel
Allow /m/company
Allow /m/vimeal
Allow /m/mtn
Disallow /*viewMode%3DgoodsPreview*
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

Other Records

Field Value
crawl-delay 5

yeti

Rule Path
Allow /m/main
Allow /m/search
Allow /m/giftCardGuide
Allow /m/planshop
Allow /m/display
Allow /m/event
Allow /m/vote
Allow /m/amusement
Allow /m/specialGdas
Allow /m/mypage
Allow /m/store
Allow /m/cart
Allow /m/goods
Allow /m/login
Allow /m/myGiftCard
Allow /m/counsel
Allow /m/company
Allow /m/vimeal
Allow /m/mtn
Disallow /*viewMode%3DgoodsPreview*
Disallow /*goodsNo%3DF*
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

Other Records

Field Value
crawl-delay 5

daumoa

Rule Path
Allow /m/main
Allow /m/search
Allow /m/giftCardGuide
Allow /m/planshop
Allow /m/display
Allow /m/event
Allow /m/vote
Allow /m/amusement
Allow /m/specialGdas
Allow /m/mypage
Allow /m/store
Allow /m/cart
Allow /m/goods
Allow /m/login
Allow /m/myGiftCard
Allow /m/counsel
Allow /m/company
Allow /m/vimeal
Allow /m/mtn
Disallow /*viewMode%3DgoodsPreview*
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

Other Records

Field Value
crawl-delay 5

twitterbot

Rule Path
Allow /m/intangible
Allow /m/mtn
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

Other Records

Field Value
crawl-delay 5

facebookexternalhit

Rule Path
Allow /m/main
Allow /m/search
Allow /m/giftCardGuide
Allow /m/planshop
Allow /m/display
Allow /m/event
Allow /m/vote
Allow /m/amusement
Allow /m/specialGdas
Allow /m/mypage
Allow /m/store
Allow /m/cart
Allow /m/goods
Allow /m/login
Allow /m/myGiftCard
Allow /m/counsel
Allow /m/company
Allow /m/vimeal
Allow /m/mtn
Disallow /*viewMode%3DgoodsPreview*
Disallow /m/live/broadcast/gate*
Disallow /m/main/getQuickMainList.do*

Other Records

Field Value
crawl-delay 5

Comments

  • DaumWebMasterTool:13f8da78453aa90cbefc13393ff63018d4aaa37e8586a75a99753b764902bd24:/lJDYpNEQ78RnQXN/HqAlA==