Log In Sign Up

app.meetjamie.ai
robots.txt

Robots Exclusion Standard data for app.meetjamie.ai

Resource Scan

Scan Details

Site Domain app.meetjamie.ai
Base Domain meetjamie.ai
Scan Status Ok
Last Scan2025-11-29T18:35:39+00:00
Next Scan 2025-12-13T18:35:39+00:00

Last Scan

Scanned2025-11-29T18:35:39+00:00
URL https://app.meetjamie.ai/robots.txt
Domain IPs 104.18.8.37, 104.18.9.37, 2606:4700::6812:825, 2606:4700::6812:925
Response IP 104.18.8.37
Found Yes
Hash 85a97a66f4ff16f271854ce0d3e39f548a1e4fe07b77de644d28c9b740a06667
SimHash 9010360a050c

Groups

*

Rule Path
Disallow /sharedMeeting/

gptbot

Rule Path
Disallow /sharedMeeting/

chatgpt-user

Rule Path
Disallow /sharedMeeting/

oai-searchbot

Rule Path
Disallow /sharedMeeting/

claudebot

Rule Path
Disallow /sharedMeeting/

claude-user

Rule Path
Disallow /sharedMeeting/

claude-searchbot

Rule Path
Disallow /sharedMeeting/

google-extended

Rule Path
Disallow /sharedMeeting/

ccbot

Rule Path
Disallow /sharedMeeting/

perplexitybot

Rule Path
Disallow /sharedMeeting/

perplexity-user

Rule Path
Disallow /sharedMeeting/

meta-externalagent

Rule Path
Disallow /sharedMeeting/

applebot

Rule Path
Disallow /sharedMeeting/

amazonbot

Rule Path
Disallow /sharedMeeting/

bytespider

Rule Path
Disallow /sharedMeeting/
Back to top

Comments

  • Disallow crawling of shared meeting pages
  • OpenAI crawlers and agents
  • https://platform.openai.com/docs/bots
  • Anthropic (Claude) crawlers and agents
  • https://support.anthropic.com/en/articles/8896518
  • Google AI crawlers
  • https://support.google.com/webmasters/answer/2723646
  • Common Crawl (used for AI training)
  • https://commoncrawl.org/ccbot
  • Perplexity AI
  • https://docs.perplexity.ai/guides/bots
  • Meta AI crawlers
  • https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
  • Apple crawlers
  • https://support.apple.com/en-us/119829
  • Amazon crawlers
  • https://developer.amazon.com/amazonbot
  • ByteDance/TikTok crawlers
Back to top