Log In Sign Up

navisat.md
robots.txt

Robots Exclusion Standard data for navisat.md

Resource Scan

Scan Details

Site Domain navisat.md
Base Domain navisat.md
Scan Status Ok
Last Scan2026-03-09T15:51:31+00:00
Next Scan 2026-04-08T15:51:31+00:00

Last Scan

Scanned2026-03-09T15:51:31+00:00
URL https://navisat.md/robots.txt
Domain IPs 104.21.84.8, 172.67.184.133, 2606:4700:3032::ac43:b885, 2606:4700:3034::6815:5408
Response IP 104.21.84.8
Found Yes
Hash 68bdf1bc1f6a1bc4aa38dff80aa4a0d8ee8aa062f032d5c0faf9a950dd2c861b
SimHash 5d108dc0a4b1

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://navisat.md/sitemap.xml
Back to top

Comments

  • robots.txt for Navisat.md
  • Special directives for AI/LLM crawlers
  • Sitemaps
  • LLM-specific indexing file
  • See https://navisat.md/llms.txt for AI-optimized content
Back to top