Log In Sign Up

comparateur-or.com
robots.txt

Robots Exclusion Standard data for comparateur-or.com

Resource Scan

Scan Details

Site Domain comparateur-or.com
Base Domain comparateur-or.com
Scan Status Ok
Last Scan2026-02-18T05:01:30+00:00
Next Scan 2026-02-25T05:01:30+00:00

Last Scan

Scanned2026-02-18T05:01:30+00:00
URL https://comparateur-or.com/robots.txt
Domain IPs 51.91.96.61
Response IP 51.91.96.61
Found Yes
Hash 55073201d636201e8139e87eb9cd7a069bc7c0cb3d6a1089e2f8668fe00fcde6
SimHash 40100a56fc63

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /Identity/
Disallow /api/
Back to top

Other Records

Field Value
sitemap https://comparateur-or.com/sitemap.xml
Back to top

Comments

  • Robots.txt for comparateur-or.com
  • Sitemap
  • LLMs.txt - Documentation for AI assistants
  • See https://llmstxt.org for specification
  • AI Crawlers - Explicitly allowed
  • Disallow admin and private areas
Back to top

Warnings

  • `llms-full-txt` is not a known field.
  • `llms-txt` is not a known field.
Back to top