Log In Sign Up

1fishing.co.kr
robots.txt

Robots Exclusion Standard data for 1fishing.co.kr

Resource Scan

Scan Details

Site Domain 1fishing.co.kr
Base Domain 1fishing.co.kr
Scan Status Ok
Last Scan2025-05-10T07:50:42+00:00
Next Scan 2025-06-09T07:50:42+00:00

Last Scan

Scanned2025-05-10T07:50:42+00:00
URL https://1fishing.co.kr/robots.txt
Domain IPs 210.114.6.189
Response IP 210.114.6.189
Found Yes
Hash 4be44c46fb989f5cd106be3b83f988186edcd954619a5e4cea03964d0f10078e
SimHash 7153c440e880

Groups

amazonbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow *

bdcbot

Rule Path
Disallow *

businessbot

Rule Path
Disallow *

dataprovider.com

Rule Path
Disallow *

dialogsearch.com bot

Rule Path
Disallow *

digincore crawler bot

Rule Path
Disallow *

domainsigmacrawler

Rule Path
Disallow *

googlebot-image

Rule Path
Disallow *

gptbot

Rule Path
Disallow *

kisabot

Rule Path
Disallow *

mail.ru_bot

Rule Path
Disallow *

mediavbot

Rule Path
Disallow *

memorybot

Rule Path
Disallow *

mfibot

Rule Path
Disallow *

msnbot-media

Rule Path
Disallow *

neumobbot

Rule Path
Disallow *

pageanalyzer

Rule Path
Disallow *

pagesinventory

Rule Path
Disallow *

plukkie

Rule Path
Disallow *

roboto

Rule Path
Disallow *

rogerbot

Rule Path
Disallow *

rsnbot

Rule Path
Disallow *

safednsbot

Rule Path
Disallow *

semanticbot

Rule Path
Disallow *

smtbot

Rule Path
Disallow *

surveybot

Rule Path
Disallow *

turnitinbot

Rule Path
Disallow *

uxcrawlerbot

Rule Path
Disallow *

wotbox

Rule Path
Disallow *

adsbot-naver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

domaincrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

megaindex.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

alphabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ltx71

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

piplbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ezooms

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sistrix

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

daum

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

yeti
daumoa

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

yeti
googlebot

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

yeti
googlebot-mobile

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

yeti
mediapartners-google

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

yeti

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*

zumbot

Rule Path
Disallow /.well-known/
Disallow /adm/
Disallow /bbs/
Disallow /data/
Disallow /extend/
Disallow /img/
Disallow /install/
Disallow /lib/
Disallow /m33512/
Disallow /mobile/
Disallow /Photoshop/
Disallow /plugin/
Disallow /skin/
Disallow /theme/
Allow /css/
Allow /js/
Allow /bbs/content.php?*co_id=*
Allow /bbs/board.php?*bo_table=*
Back to top

Other Records

Field Value
sitemap https://1fishing.co.kr/sitemap.php
Back to top

Comments

  • 허용 X 로봇 리스트
  • 허용 △ 로봇 리스트
  • 허용 O 로봇 리스트
  • 사이트맵 주소
Back to top