korea2me.com
robots.txt

Robots Exclusion Standard data for korea2me.com

Resource Scan

Scan Details

Site Domain korea2me.com
Base Domain korea2me.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-10-18T12:25:36+00:00
Next Scan 2025-11-17T12:25:36+00:00

Last Successful Scan

Scanned2025-09-19T04:55:56+00:00
URL https://www.korea2me.com/robots.txt
Domain IPs 13.35.202.105, 13.35.202.111, 13.35.202.115, 13.35.202.80
Response IP 13.35.202.111
Found Yes
Hash 1b88a03c24dfd9230a80acac64801ebd2b476a2d5119d6d5088e1ff336529be0
SimHash 124cc04a9d1a

Groups

*

Rule Path
Allow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

linkdexbot/2.1

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

searchie/1.0

Rule Path
Disallow /

searchie

Rule Path
Disallow /

www.searchie.org

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

kraken

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Comments

  • User-agent: Baiduspider
  • User-agent: Baiduspider-video
  • User-agent: Baiduspider-image
  • Disallow: /