Log In Sign Up

fruition.net
robots.txt

Robots Exclusion Standard data for fruition.net

Resource Scan

Scan Details

Site Domain fruition.net
Base Domain fruition.net
Scan Status Ok
Last Scan2025-12-22T09:51:28+00:00
Next Scan 2026-01-05T09:51:28+00:00

Last Scan

Scanned2025-12-22T09:51:28+00:00
URL https://fruition.net/robots.txt
Domain IPs 172.66.40.96, 172.66.43.160, 2606:4700:3108::ac42:2860, 2606:4700:3108::ac42:2ba0
Response IP 172.66.40.96
Found Yes
Hash a04678d0f2ef48143e8d8c4c8169db96544fc1108763beac44d2685237bbd512
SimHash 6512d3c3d504

Groups

chatgpt-user
gptbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

claudebot
claude-web

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

perplexitybot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

google-extended
googleother

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

applebot-extended

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

anthropic-ai
ai2bot
bytespider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot
googlebot-image
googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp
duckduckbot
baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /_astro/
Disallow /node_modules/
Disallow /.git/
Disallow /test/
Disallow /dev/
Back to top

Other Records

Field Value
sitemap https://fruition.net/sitemap.xml
sitemap https://fruition.net/sitemap-0.xml
Back to top

Comments

  • Robots.txt for Fruition.net
  • Updated November 2025 for AI Search Engine Optimization
  • For AI-specific information, see: https://fruition.net/llms.txt
  • ============================================
  • AI Search Engine Crawlers (2025)
  • ============================================
  • OpenAI (ChatGPT, GPT-4)
  • Anthropic (Claude)
  • Perplexity AI
  • Google AI (Gemini, Bard)
  • Microsoft Bing AI
  • Other AI Crawlers
  • ============================================
  • Traditional Search Engines
  • ============================================
  • Google
  • Bing
  • Other Search Engines
  • ============================================
  • Default Rule (All Other Crawlers)
  • ============================================
  • ============================================
  • Disallow Private/Admin Paths
  • ============================================
  • Block admin areas
  • ============================================
  • Sitemaps
  • ============================================
  • ============================================
  • AI-Specific Resources
  • ============================================
  • For AI search engines, see llms.txt for:
  • - Company overview and services
  • - Citation guidelines
  • - Content priorities
  • - Structured business information
  • URL: https://fruition.net/llms.txt
Back to top