Log In Sign Up

juniphq.com
robots.txt

Robots Exclusion Standard data for juniphq.com

Resource Scan

Scan Details

Site Domain juniphq.com
Base Domain juniphq.com
Scan Status Ok
Last Scan2025-08-20T07:35:32+00:00
Next Scan 2025-09-19T07:35:32+00:00

Last Scan

Scanned2025-08-20T07:35:32+00:00
URL https://juniphq.com/robots.txt
Redirect https://junip.co/robots.txt
Redirect Domain junip.co
Redirect Base junip.co
Domain IPs 13.248.244.96, 35.71.179.82, 75.2.60.68, 99.83.220.108
Redirect IPs 13.248.244.96, 35.71.179.82, 75.2.60.68, 99.83.220.108
Response IP 75.2.60.68
Found Yes
Hash 6e9d3ef2a46fb5f55ff2135d22649638b7e5197926281ad27744d22e647c46fe
SimHash 05186e402de8

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://junip.co/sitemap.xml
Back to top

Comments

  • Junip - Review Management Platform for Shopify
  • Last Updated: 2025-08-19
  • https://www.robotstxt.org/robotstxt.html
  • Default access for all web crawlers
  • Search Engine Bots
  • AI/LLM Bots - Full Access
  • Social Media Bots
  • LLM Configuration Files
  • Sitemap
  • Canonical Host
Back to top

Warnings

  • `ai-content` is not a known field.
  • `api-docs` is not a known field.
  • `host` is not a known field.
  • `llm-config` is not a known field.
Back to top