Log In Sign Up

paddlepalace.com
robots.txt

Robots Exclusion Standard data for paddlepalace.com

Resource Scan

Scan Details

Site Domain paddlepalace.com
Base Domain paddlepalace.com
Scan Status Ok
Last Scan2025-12-13T20:26:15+00:00
Next Scan 2026-01-12T20:26:15+00:00

Last Scan

Scanned2025-12-13T20:26:15+00:00
URL https://www.paddlepalace.com/robots.txt
Response IP 45.223.66.217
Found Yes
Hash 0c03715af34c50796b8ac0e2796ec303aaf647cc39dbe1c0cfed2d1b83826256
SimHash 6d1b927046b4

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

bingbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

magpie-crawler

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

youbot

Rule Path
Allow /

neevabot

Rule Path
Allow /
Disallow /admin/
Disallow /checkout/
Disallow /cart/
Disallow /account/
Disallow /login/
Disallow /register/
Back to top

Other Records

Field Value
sitemap https://www.paddlepalace.com/sitemap.xml
sitemap https://www.paddlepalace.com/mobile/sitemap.xml
Back to top

Comments

  • PaddlePalace.com Robots.txt
  • Optimized for Google, Bing, OpenAI, Perplexity, Anthropic, and other LLM search agents
  • OpenAI ChatGPT Bots
  • Anthropic's Claude
  • Microsoft Copilot (via Bing)
  • Googlebot (used by Gemini)
  • Perplexity AI
  • Manus / Magpie Crawler
  • DuckDuckGo
  • You.com AI Search
  • NeevaBot (legacy, now Snowflake)
  • Disallow sensitive or non-indexable paths
  • Declare full and mobile sitemaps
Back to top