btheegg.com
robots.txt

Robots Exclusion Standard data for btheegg.com

Resource Scan

Scan Details

Site Domain btheegg.com
Base Domain btheegg.com
Scan Status Ok
Last Scan2025-11-23T02:49:52+00:00
Next Scan 2025-12-23T02:49:52+00:00

Last Scan

Scanned2025-11-23T02:49:52+00:00
URL https://www.btheegg.com/robots.txt
Redirect https://www.morulive.com/robots.txt
Redirect Domain www.morulive.com
Redirect Base morulive.com
Domain IPs 108.157.254.122, 108.157.254.32, 108.157.254.49, 108.157.254.57
Redirect IPs 13.35.238.118, 13.35.238.22, 13.35.238.41, 13.35.238.44
Response IP 13.35.238.118
Found Yes
Hash 23453c68845aba7df68234be0cf9c84ed5b4bcb9d24df6ba3856ae12b4f6dc62
SimHash 4b1408d2eb80

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

naverbot

Rule Path
Allow /

daumbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /*.json$
Disallow /*?*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://morulive.com/sitemap.xml

Comments

  • 사이트맵 위치
  • 주요 검색봇 허용
  • 불필요한 크롤링 방지
  • 크롤링 지연 설정 (서버 부하 방지)