Log In Sign Up

incipiokorea.com
robots.txt

Robots Exclusion Standard data for incipiokorea.com

Resource Scan

Scan Details

Site Domain incipiokorea.com
Base Domain incipiokorea.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-11T04:37:31+00:00
Next Scan 2026-03-11T04:37:31+00:00

Last Successful Scan

Scanned2025-04-22T01:58:37+00:00
URL https://incipiokorea.com/robots.txt
Domain IPs 133.186.250.249
Response IP 133.186.250.249
Found Yes
Hash 02ad41e333f52e9daca4b293a845eb8131dc55b6536ccf40a9cb83fbeb9288c3
SimHash b054100347c2

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

cowbot
naverbot
yeti
daumoa

Rule Path
Disallow /admin/
Disallow /config/
Disallow /data/
Disallow /module/
Disallow /tmp/

mj12bot
semrushbot
claudebot
gptbot

Rule Path
Disallow /

facebookexternalhit
dotbot
screaming frog seo spide
heritrix
bingbot
owasp
geofeed
dirbuster-1.0-rc1
pfinapp
droid build
googlebot
cowbot
yeti
ads-naver
blueno
daumoa

Rule Path
Disallow /admin/
Disallow /config/
Disallow /data/
Disallow /module/
Disallow /tmp/

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Default Bot Policy List provided by GODOMALL
Back to top