dandell.com
robots.txt

Robots Exclusion Standard data for dandell.com

Resource Scan

Scan Details

Site Domain dandell.com
Base Domain dandell.com
Scan Status Ok
Last Scan2025-10-27T19:26:38+00:00
Next Scan 2025-11-26T19:26:38+00:00

Last Scan

Scanned2025-10-27T19:26:38+00:00
URL https://dandell.com/robots.txt
Domain IPs 72.52.138.122
Response IP 72.52.138.122
Found Yes
Hash 5ed6eaa524bbdaf37ba92bed422805e23b3ad50aed3cd4caeca2477086cc018c
SimHash 20681ed1cf93

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://dandell.com/sitemap_index.xml

Comments

  • robots.txt for Danziger & DeLlano (dandell.com)
  • Standard crawler rules + Cloudflare Content Signals for AI usage control
  • Sitemap (for SEO / crawler discovery)
  • Cloudflare Content Signals Policy — specify preferred uses of your content
  • (yes = allowed, no = disallowed, absence = no explicit preference)
  • Content signals definitions:
  • - search: inclusion in search indexes / search results (short excerpts allowed)
  • - ai-input: content used as input context in AI models (e.g. RAG, grounding, summarization)
  • - ai-train: content used to train or fine-tune AI models
  • Example: allow search, allow input, disallow training

Warnings

  • `content-signal` is not a known field.