Log In Sign Up

paddleguide.com
robots.txt

Robots Exclusion Standard data for paddleguide.com

Resource Scan

Scan Details

Site Domain paddleguide.com
Base Domain paddleguide.com
Scan Status Ok
Last Scan2025-08-30T00:13:06+00:00
Next Scan 2025-09-06T00:13:06+00:00

Last Scan

Scanned2025-08-30T00:13:06+00:00
URL https://paddleguide.com/robots.txt
Redirect https://www.paddleguide.com/robots.txt
Redirect Domain www.paddleguide.com
Redirect Base paddleguide.com
Domain IPs 216.198.79.1
Redirect IPs 216.198.79.65, 64.29.17.65
Response IP 64.29.17.1
Found Yes
Hash cb179ac9bd0efaa5f865db1480b45ca2b0d68eed157ee9715d720e96664441bf
SimHash 58908840e17b

Groups

facebookexternalhit

Rule Path
Allow /

facebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

slackbot

Rule Path
Allow /

redditbot

Rule Path
Allow /

pinterest

Rule Path
Allow /

discordbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • ✅ Allow social sharing crawlers
  • 🚫 Block AI scrapers, SEO bots, and archives
  • 🚫 Block all others (optional)
Back to top