Log In Sign Up

muniverse.io
robots.txt

Robots Exclusion Standard data for muniverse.io

Resource Scan

Scan Details

Site Domain muniverse.io
Base Domain muniverse.io
Scan Status Ok
Last Scan2025-09-19T14:45:42+00:00
Next Scan 2025-09-26T14:45:42+00:00

Last Scan

Scanned2025-09-19T14:45:42+00:00
URL https://muniverse.io/robots.txt
Redirect https://www.muniverse.io/robots.txt
Redirect Domain www.muniverse.io
Redirect Base muniverse.io
Domain IPs 3.165.102.10, 3.165.102.103, 3.165.102.87, 3.165.102.99
Redirect IPs 108.157.254.126, 108.157.254.57, 108.157.254.61, 108.157.254.91
Response IP 108.157.254.126
Found Yes
Hash 42951fc3b728294e3c7d444ed0a9d738ce608ae95a574d271decda97f3e74b9d
SimHash 882d5a06c131

Groups

*

Rule Path
Allow /
Disallow /auth/twitter/callback
Disallow /order
Disallow /order/complete
Disallow /order/fail
Disallow /mypage
Disallow /policy
Back to top

Other Records

Field Value
sitemap https://www.muniverse.io/sitemap.xml
Back to top

Comments

  • 서브도메인 차단 (절대 URL 방식, 비표준이지만 주요 크롤러는 준수)
  • 검색엔진이 접근하지 않았으면 하는 경로
  • 사이트맵 위치
Back to top

Warnings

  • 6 invalid lines.
Back to top