Log In Sign Up

oversystem.co.kr
robots.txt

Robots Exclusion Standard data for oversystem.co.kr

Resource Scan

Scan Details

Site Domain oversystem.co.kr
Base Domain oversystem.co.kr
Scan Status Ok
Last Scan2024-06-01T02:04:59+00:00
Next Scan 2024-06-08T02:04:59+00:00

Last Scan

Scanned2024-06-01T02:04:59+00:00
URL https://oversystem.co.kr/robots.txt
Domain IPs 104.26.0.240, 104.26.1.240, 172.67.74.167, 2606:4700:20::681a:1f0, 2606:4700:20::681a:f0, 2606:4700:20::ac43:4aa7
Response IP 172.67.74.167
Found Yes
Hash 406f7d48c4c6b41ec2d23163e32ca205bd40b8990a825933b7f6d82c4fd674b5
SimHash 597310666ad1

Groups

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

contacts-crawler

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dialogsearch.com bot

Rule Path
Disallow /

digincore crawler bot

Rule Path
Disallow /

domainsigmacrawler

Rule Path
Disallow /

kisabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediavbot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

neumobbot

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

roboto

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rsnbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

uxcrawlerbot

Rule Path
Disallow /

virusdie crawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

adsbot-naver

Rule Path
Allow /

bingbot

Rule Path
Allow /

daum

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

haosouspider

Rule Path
Allow /

yeti

Rule Path
Allow /

zumbot

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600
Back to top

Other Records

Field Value
sitemap https://oversystem.co.kr/sitemap.xml
Back to top

Warnings

  • 6 invalid lines.
Back to top