ahg.co.kr
robots.txt

Robots Exclusion Standard data for ahg.co.kr

Resource Scan

Scan Details

Site Domain ahg.co.kr
Base Domain ahg.co.kr
Scan Status Ok
Last Scan2025-05-30T22:11:07+00:00
Next Scan 2025-06-06T22:11:07+00:00

Last Scan

Scanned2025-05-30T22:11:07+00:00
URL https://ahg.co.kr/robots.txt
Domain IPs 104.21.5.26, 172.67.132.198, 2606:4700:3035::6815:51a, 2606:4700:3036::ac43:84c6
Response IP 104.21.5.26
Found Yes
Hash a96692d2e1dfcce4392b9b22228a4a527389cf947157d6a3c6f76415acb499f9
SimHash c95b7400e2d0

Groups

ahrefsbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dialogsearch.com bot

Rule Path
Disallow /

digincore crawler bot

Rule Path
Disallow /

domainsigmacrawler

Rule Path
Disallow /

kisabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediavbot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

neumobbot

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

roboto

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rsnbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

uxcrawlerbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

adsbot-naver

Rule Path
Allow

daum

Rule Path
Allow

daumoa

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-mobile

Rule Path
Allow

googlebot-news

Rule Path
Allow

googlebot-image

Rule Path
Allow

googlebot-video

Rule Path
Allow

adsbot-google

Rule Path
Allow

mediapartners-google

Rule Path
Allow

yeti

Rule Path
Allow

zumbot

Rule Path
Allow

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

chatglm-spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.982.kr/sitemap.php

Warnings

  • 3 invalid lines.