Log In Sign Up

itpe.co.kr
robots.txt

Robots Exclusion Standard data for itpe.co.kr

Resource Scan

Scan Details

Site Domain itpe.co.kr
Base Domain itpe.co.kr
Scan Status Ok
Last Scan2024-06-09T03:37:44+00:00
Next Scan 2024-07-09T03:37:44+00:00

Last Scan

Scanned2024-06-09T03:37:44+00:00
URL https://itpe.co.kr/robots.txt
Domain IPs 210.122.35.94
Response IP 210.122.35.94
Found Yes
Hash 6474bdac78bd3011b9b203bc8bb7cea7beef140bc66936373123ee8ac527f20a
SimHash ba11746540c9

Groups

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

yahoo slurp

Rule Path
Disallow /

yahoo pipes

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

contacts-crawler

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

alexa/internet archive

Rule Path
Disallow /

idbot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

picsearch

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

virusdie crawler

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top