modumart.co.kr
robots.txt

Robots Exclusion Standard data for modumart.co.kr

Resource Scan

Scan Details

Site Domain modumart.co.kr
Base Domain modumart.co.kr
Scan Status Ok
Last Scan2025-10-24T04:18:14+00:00
Next Scan 2025-11-23T04:18:14+00:00

Last Scan

Scanned2025-10-24T04:18:14+00:00
URL https://modumart.co.kr/robots.txt
Redirect https://www.modumart.co.kr/robots.txt
Redirect Domain www.modumart.co.kr
Redirect Base modumart.co.kr
Domain IPs 216.198.79.65, 64.29.17.1
Redirect IPs 216.198.79.1, 216.198.79.65
Response IP 216.198.79.65
Found Yes
Hash abd7056872c9700aa1b601bdab8bff8979fe72a1408410d9f7611505645e78fa
SimHash 601554f3e730

Groups

*

Rule Path
Allow /
Disallow /*?search=

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.modumart.co.kr/sitemap.xml

Comments

  • Prevent indexing of parameter-based internal search results
  • Sitemaps
  • RSS Feed
  • https://www.modumart.co.kr/rss.xml
  • Crawl-delay for respectful crawling
  • Disallow admin or private paths (if any)
  • Disallow: /admin/
  • Disallow: /private/