Log In Sign Up

pikalytics.com
robots.txt

Robots Exclusion Standard data for pikalytics.com

Resource Scan

Scan Details

Site Domain pikalytics.com
Base Domain pikalytics.com
Scan Status Ok
Last Scan2026-03-10T20:12:08+00:00
Next Scan 2026-03-17T20:12:08+00:00

Last Scan

Scanned2026-03-10T20:12:08+00:00
URL https://pikalytics.com/robots.txt
Domain IPs 104.21.36.5, 172.67.182.171, 2606:4700:3032::6815:2405, 2606:4700:3033::ac43:b6ab
Response IP 104.21.36.5
Found Yes
Hash eb7db77498acde9659c3e6d97111bca9f92bb2c7f29d9a155535683f91858b7b
SimHash 695012092e26

Groups

*

Rule Path
Allow /
Disallow /.tmp/
Disallow /node_modules/

oai-searchbot

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

chatgpt-user

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

gptbot

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

claudebot

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

anthropic-ai

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

claude-web

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

perplexitybot

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

perplexity-user

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

google-extended

Rule Path
Allow /
Allow /ai/
Allow /llms.txt
Allow /llms-full.txt

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

applebot

Rule Path
Allow /
Allow /ai/

facebookbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /
Allow /ai/

youbot

Rule Path
Allow /
Allow /ai/
Back to top

Other Records

Field Value
sitemap https://www.pikalytics.com/sitemap.xml
sitemap https://www.pikalytics.com/sitemapregh.xml
sitemap https://www.pikalytics.com/sitemapza.xml
sitemap https://www.pikalytics.com/sitemapsvou2.xml
sitemap https://www.pikalytics.com/ai-sitemap.xml
Back to top

Comments

  • Pikalytics robots.txt
  • Last Updated: 2026-01-22
  • Contact: @Pikalytics on Twitter
  • Default Rules - Allow all crawlers
  • ===========================================
  • AI CRAWLER SPECIFIC DIRECTIVES - OPTIMIZED FOR AEO
  • ===========================================
  • OpenAI ChatGPT Search Bot - ALLOW for search citations
  • OpenAI ChatGPT User - ALLOW for user-requested content
  • OpenAI GPTBot - ALLOW for model training (we want Pikalytics in AI knowledge)
  • Anthropic Claude - ALLOW for Claude citations
  • Anthropic Training Bot - ALLOW
  • Claude Web Fetcher
  • Perplexity Bot - ALLOW for AI search
  • Perplexity User - ALLOW
  • Google AI/Bard/Gemini Extended - ALLOW
  • Google Common Crawlers
  • Microsoft Copilot/Bing Chat
  • Apple Intelligence & Siri
  • Meta AI
  • Cohere AI
  • You.com AI Search
  • ===========================================
  • SITEMAPS
  • ===========================================
  • AI-Specific Sitemap (for AI crawlers)
  • ===========================================
  • AI CONTENT DISCOVERY
  • ===========================================
  • LLMs.txt files for AI agents
  • https://www.pikalytics.com/llms.txt - Quick overview
  • https://www.pikalytics.com/llms-full.txt - Full context
  • https://www.pikalytics.com/ai-sitemap.xml - AI endpoints sitemap (XML)
  • https://www.pikalytics.com/ai-sitemap.md - AI endpoints sitemap (Markdown)
  • AI-Optimized Endpoints
  • Pattern: https://www.pikalytics.com/ai/pokedex/[format]/[pokemon]
  • Returns: Markdown-formatted competitive usage statistics
Back to top