soccerline.kr
robots.txt

Robots Exclusion Standard data for soccerline.kr

Resource Scan

Scan Details

Site Domain soccerline.kr
Base Domain soccerline.kr
Scan Status Ok
Last Scan2024-11-16T17:59:22+00:00
Next Scan 2024-11-23T17:59:22+00:00

Last Scan

Scanned2024-11-16T17:59:22+00:00
URL https://soccerline.kr/robots.txt
Domain IPs 111.92.191.55
Response IP 111.92.191.55
Found Yes
Hash a1fb0c72475d21761376b2670f5b1e270fc50d0f1ab2a0b4e7597dbac2679c13
SimHash 09505e825412

Groups

*

Rule Path
Disallow /
Disallow /member/
Disallow /admin/
Disallow /api/

googlebot

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

googlebot-image

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

googlebot-mobile

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

mediapartners-google

Rule Path
Allow /
Disallow /admin/
Disallow /api/

adsbot-google

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

msnbot

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

slurp

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

teoma

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

twiceler

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

gigabot

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

scrubby

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

robozilla

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

nutch

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

ia_archiver

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

baiduspider

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

naverbot

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

yeti

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

yeti

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

yahoo-mmcrawler

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

psbot

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

asterias

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

yahoo-blogs/v3.9

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

daum

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

daum/4.1

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

facebookexternalhit

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

facebookexternalhit/1.1

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

kakaotalk-scrap

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

kakaotalk-scrap/1.0

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

daumoa-image

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/

daumoa-image/1.0

Rule Path
Allow /
Disallow /member/
Disallow /admin/
Disallow /api/