doctornow.co.kr
robots.txt

Robots Exclusion Standard data for doctornow.co.kr

Resource Scan

Scan Details

Site Domain doctornow.co.kr
Base Domain doctornow.co.kr
Scan Status Ok
Last Scan2024-11-09T21:18:50+00:00
Next Scan 2024-11-16T21:18:50+00:00

Last Scan

Scanned2024-11-09T21:18:50+00:00
URL https://doctornow.co.kr/robots.txt
Domain IPs 15.164.25.75, 3.37.163.181, 3.37.75.156
Response IP 3.37.163.181
Found Yes
Hash 00fdfe4cace0255b095de6dbfc601502804809236dc71f1bc4484e971468750f
SimHash 06ddfef62520

Groups

*

Rule Path
Allow /
Disallow /login
Disallow /content/qna/write
Disallow /content/qna/write/complete
Disallow /content/community/policy
Disallow /content/qna/nps
Disallow /content/qna/search
Disallow /content/qna/service
Disallow /content/search
Disallow /content/naver/loginCallback
Disallow /content/kakao/loginCallback
Disallow /content/mypage
Disallow /content/error
Disallow /content/complete
Disallow /content/board
Disallow /content/report
Disallow /content/community/write
Disallow /content/community/setting
Disallow /content/bookings
Disallow /kakao/pay/**
Disallow /search
Disallow /search/**
Disallow /content/magazine/category
Disallow /pointMarket
Disallow /pointMarket/**
Disallow /hospitals/medical/**
Disallow /pharmacies/**
Disallow /point/**
Disallow /mission/**
Disallow /doctors/**
Disallow /prescription/**
Disallow /cards/**
Disallow /diagnosis/**

Other Records

Field Value
crawl-delay 10

a6-indexer

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blackboard safeassign

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

qwant-news

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

oai-searchbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://doctornow.co.kr/doctornow-sitemap.xml
sitemap https://doctornow.co.kr/sitemap/hospital-index.xml
sitemap https://doctornow.co.kr/sitemap/content-index.xml
sitemap https://doctornow.co.kr/sitemap/non-benefit-index.xml

Comments

  • *
  • A6-Indexer
  • AlphaSeoBot
  • AlphaSeoBot-SA
  • AspiegelBot
  • barkrowler
  • Blackboard Safeassign
  • BLEXBot
  • Bytespider
  • crawler4j
  • DataForSeoBot
  • DotBot
  • Gigabot
  • LieBaoFast
  • MauiBot
  • MauiBot (crawler.feedback+wc@gmail.com)
  • MegaIndex.ru/2.0
  • MqqBrowser
  • Nimbostratus-Bot/v1.3.2
  • Qwant-news
  • Qwantify
  • Seekport Crawler
  • SemrushBot
  • SemrushBot-SA
  • SeznamBot
  • SputnikBot/2.3
  • The Knowledge AI
  • Timpibot/0.8
  • TinyTestBot
  • UCBrowser
  • yacybot
  • YandexBot
  • YandexBot/3.0
  • YisouSpider
  • OAI-SearchBot
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.