Log In Sign Up

privatecommunities.com
robots.txt

Robots Exclusion Standard data for privatecommunities.com

Resource Scan

Scan Details

Site Domain privatecommunities.com
Base Domain privatecommunities.com
Scan Status Ok
Last Scan2025-11-21T08:52:09+00:00
Next Scan 2025-12-21T08:52:09+00:00

Last Scan

Scanned2025-11-21T08:52:09+00:00
URL https://privatecommunities.com/robots.txt
Redirect https://www.privatecommunities.com/robots.txt
Redirect Domain www.privatecommunities.com
Redirect Base privatecommunities.com
Domain IPs 204.12.14.178
Redirect IPs 204.12.14.178
Response IP 204.12.14.178
Found Yes
Hash 05b2211d057df14625b39eda6568a82e4e8aa9705aebc38bc8a5889d614e1c46
SimHash 699499fa34f5

Groups

chatgpt*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claude*

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

claude-user

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexity*

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexitybot/1.0

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

google-extended

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

google-favicon

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

google-structured-data-testing-tool

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

bingai

Rule Path
Allow /

microsoft-extended

Rule Path
Allow /

adidxbot

Rule Path
Allow /

adidxsmbot

Rule Path
Allow /

bingimagebot

Rule Path
Allow /

bingvideobot

Rule Path
Allow /

bingfaviconbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

ccbot*

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.privatecommunities.com/sitemapindex.xml
Back to top

Comments

  • /robots.txt for https://www.privatecommunities.com/
  • comments to webmaster@privatecommunities.com
  • ===============================
  • OpenAI / ChatGPT Crawlers
  • ===============================
  • Wildcard to cover future ChatGPT variants
  • ===============================
  • Anthropic / Claude AI Crawlers
  • ===============================
  • Wildcard to cover future Claude variants
  • ===============================
  • Perplexity AI Crawlers
  • ===============================
  • Wildcard to cover future Perplexity variants
  • ===============================
  • Google Crawlers
  • ===============================
  • ===============================
  • Bing / Microsoft Crawlers
  • ===============================
  • ===============================
  • Other Crawlers
  • ===============================
  • ===============================
  • General access
  • ===============================
Back to top