Log In Sign Up

monomart.com
robots.txt

Robots Exclusion Standard data for monomart.com

Resource Scan

Scan Details

Site Domain monomart.com
Base Domain monomart.com
Scan Status Ok
Last Scan2025-10-01T05:52:56+00:00
Next Scan 2025-10-31T05:52:56+00:00

Last Scan

Scanned2025-10-01T05:52:56+00:00
URL https://monomart.com/robots.txt
Domain IPs 133.186.132.237
Response IP 133.186.132.237
Found Yes
Hash 34f795e2c7ea9bd9fb0e7f206ebdfdbb90ee2eb4f55e2be74ef14a7a62af7258
SimHash b0541881e7c2

Groups

*

Rule Path
Disallow /

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

cowbot
daumoa

Rule Path
Disallow
Disallow /admin/
Disallow /config/
Disallow /data/
Disallow /module/
Disallow /tmp/

mj12bot
semrushbot
claudebot
gptbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow

dotbot
screaming frog seo spider
heritrix
bingbot
owasp
geofeed
dirbuster-1.0-rc1
pfinapp
droid build
ads-naver
blueno

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • DaumWebMasterTool:0276b28a97210e82c50619a
  • Default Bot Policy List provided by GODO
Back to top