Log In Sign Up

emerson.kr
robots.txt

Robots Exclusion Standard data for emerson.kr

Resource Scan

Scan Details

Site Domain emerson.kr
Base Domain emerson.kr
Scan Status Ok
Last Scan2024-10-17T05:56:56+00:00
Next Scan 2024-11-16T05:56:56+00:00

Last Scan

Scanned2024-10-17T05:56:56+00:00
URL https://emerson.kr/robots.txt
Domain IPs 20.29.109.0
Response IP 20.29.109.0
Found Yes
Hash dab36829e9d6c321a2d5ef20dc77e97c91da47862f51a3b70593625e5449557c
SimHash 601373508ada

Groups

*

Rule Path
Disallow /catalog/SearchDisplay*
Disallow /catalog/SearchDisplay/*
Disallow /wcsstore/*
Disallow /*asset-detail
Disallow */404-not-found
Disallow /webapp/
Allow /webapp/wcs/stores/servlet/sitemap

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

affectv

Rule Path
Disallow /

apptusbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bixocrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

bot for jce

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

curious george

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exb language crawler

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fr_crawler

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

monitis

Rule Path
Disallow /

custo 3 (netwu.com)

Rule Path
Disallow /

nl-crawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

operations

Rule Path
Disallow /

picsearch

Rule Path
Disallow /

pingdom.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

searchbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

spiderlytics

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

www.creativeresearchindexer.com

Rule Path
Disallow /

wubaiyispider

Rule Path
Disallow /

urlcrawler

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

union select

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

system center operations manager 2007

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

superpagesurlverifybot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

sspider_080915

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

whitehat

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.emerson.kr/service-sitemap-emerson-electric-ko-kr-sitemap_index.xml
sitemap https://www.emerson.com/service-sitemap-emerson-electric-shared-sitemap_index.xml
sitemap https://www.emerson.kr/webapp/wcs/stores/servlet/sitemap_20151.xml.gz
Back to top

Warnings

  • 2 invalid lines.
Back to top