Log In Sign Up

notifly.tech
robots.txt

Robots Exclusion Standard data for notifly.tech

Resource Scan

Scan Details

Site Domain notifly.tech
Base Domain notifly.tech
Scan Status Ok
Last Scan2026-02-26T22:55:48+00:00
Next Scan 2026-03-12T22:55:48+00:00

Last Scan

Scanned2026-02-26T22:55:48+00:00
URL https://notifly.tech/robots.txt
Domain IPs 104.18.8.21, 104.18.9.21, 2606:4700::6812:815, 2606:4700::6812:915
Response IP 104.18.8.21
Found Yes
Hash 07a31b316bceea2aea8b9833ef803a782260bb59b9e857843669587778c65cf4
SimHash 7b3a9f400c13

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

gptbot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

chatgpt-user

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

claude-web

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

claudebot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

google-extended

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

perplexitybot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

amazonbot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

cohere-ai

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

facebookbot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

applebot-extended

Rule Path
Allow /
Disallow /api/
Disallow /landing-test

ccbot

Rule Path
Allow /
Disallow /api/
Disallow /landing-test
Back to top

Other Records

Field Value
sitemap https://notifly.tech/sitemap.xml
Back to top

Comments

  • Notifly robots.txt
  • https://notifly.tech
  • Default rules for all crawlers
  • AI Crawlers - Explicitly allowed for GEO (Generative Engine Optimization)
  • OpenAI
  • Anthropic
  • Google AI
  • Perplexity
  • Amazon
  • Cohere
  • Meta
  • Apple
  • Common Crawl (used by many AI systems)
  • Sitemap
  • LLM-specific files
  • llms.txt: https://notifly.tech/llms.txt
  • ai.txt: https://notifly.tech/.well-known/ai.txt
Back to top