Log In Sign Up

alacarte.direct
robots.txt

Robots Exclusion Standard data for alacarte.direct

Resource Scan

Scan Details

Site Domain alacarte.direct
Base Domain alacarte.direct
Scan Status Ok
Last Scan2026-02-24T16:26:24+00:00
Next Scan 2026-03-03T16:26:24+00:00

Last Scan

Scanned2026-02-24T16:26:24+00:00
URL https://alacarte.direct/robots.txt
Domain IPs 51.68.71.0
Response IP 51.68.71.0
Found Yes
Hash 160ad860edee57c421c5e2cdd201d9b5b3887c197ce41e1909e7d1a4d70dfe18
SimHash 55509a41c9f0

Groups

*

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /login
Disallow /register
Disallow /password/
Disallow /auth/
Disallow /logout
Disallow /email/verify
Disallow /api/internal/
Disallow /api/v1/
Disallow /broadcasting/
Disallow /template-preview/
Disallow /quick-create/preview/
Disallow /*?preview=
Disallow /*?test=
Disallow /*?utm_source=
Disallow /*?utm_medium=
Disallow /*?utm_campaign=
Disallow /*?utm_term=
Disallow /*?utm_content=
Disallow /*?fbclid=
Disallow /*?gclid=
Disallow /*?ref=
Disallow /*?PHPSESSID=
Disallow /*?session=
Disallow /search?
Disallow /*?page=
Disallow /*?sort=
Disallow /*?filter=
Allow /css/
Allow /js/
Allow /images/
Allow /menu/
Allow /restaurant/
Allow /fr/
Allow /en/
Disallow /fr/restaurant/
Disallow /en/restaurant/
Disallow /es/restaurant/
Disallow /pt/restaurant/
Disallow /de/restaurant/
Disallow /it/restaurant/
Disallow /hi/restaurant/
Disallow /ta/restaurant/

gptbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

gptbot-image

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

chatgpt-user

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

google-extended

Rule Path
Allow /

claudebot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

anthropic-ai

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

perplexitybot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

ccbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

meta-externalagent

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

facebookbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

applebot-extended

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

applebot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

bingbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

msnbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

amazonbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

cohere-ai

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

youbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/

duckduckbot

Rule Path
Allow /
Disallow /manager/
Disallow /admin/
Disallow /sudo/
Disallow /api/internal/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/
Disallow /sitemap-*.xml
Back to top

Other Records

Field Value
sitemap https://alacarte.direct/sitemap.xml
Back to top

Comments

  • ============================================================================
  • Robots.txt - ALaCarte.Direct
  • Optimisé pour SEO selon les bonnes pratiques 2025
  • Documentation: https://www.semrush.com/blog/beginners-guide-robots-txt/
  • ============================================================================
  • === RÈGLES POUR TOUS LES ROBOTS ===
  • === PAGES PRIVÉES / ADMINISTRATION ===
  • Bloquer les back-offices et tableaux de bord
  • === AUTHENTIFICATION & COMPTE UTILISATEUR ===
  • Bloquer les pages de connexion, inscription, réinitialisation
  • === API & ENDPOINTS INTERNES ===
  • Bloquer les APIs internes et AJAX
  • === PRÉVISUALISATIONS & TESTS ===
  • Bloquer les pages de preview et test (URLs temporaires/signées)
  • === PARAMÈTRES DE TRACKING & SESSION ===
  • Bloquer les URLs avec paramètres de tracking et session
  • === PAGES DE RECHERCHE & FILTRES ===
  • Bloquer les résultats de recherche et pages filtrées pour éviter le duplicate content
  • === FICHIERS & RESOURCES TECHNIQUES ===
  • Ne PAS bloquer CSS/JS (Google recommande de les indexer)
  • Ne PAS bloquer les images (importantes pour Google Images)
  • === PAGES IMPORTANTES À INDEXER (EXPLICITE) ===
  • S'assurer que les pages essentielles sont crawlables
  • === SEO: URLs ERRONÉES À BLOQUER (indexées par erreur) ===
  • Ces URLs /{locale}/restaurant/... n'existent pas et retournent 410
  • === AI CRAWLERS (LLMs) - AUTORISATION EXPLICITE ===
  • Ces sections rendent explicite l'autorisation de crawl pour les principaux bots IA
  • tout en respectant les mêmes restrictions que le bloc global ci-dessus.
  • OpenAI (ChatGPT)
  • OpenAI Images Crawler
  • ChatGPT user agent (browser fetcher)
  • Google Generative AI control token (non-crawler mais respecté via robots)
  • Anthropic (Claude)
  • Perplexity
  • Common Crawl (utilisé par plusieurs LLMs)
  • Meta/Facebook AI (Llama, Instagram, Facebook)
  • Apple Intelligence (Siri, Spotlight)
  • Bing/Microsoft AI (Copilot, Bing Chat)
  • Amazon AI (Alexa)
  • Cohere AI
  • YouBot (You.com AI Search)
  • DuckDuckGo AI Chat
  • ============================================================================
  • === SITEMAPS ===
  • ============================================================================
  • Sitemap index principal (mis à jour quotidiennement à 4h00)
  • Protection anti-scraping: Bloquer accès direct aux sitemaps individuels
  • Les moteurs de recherche légitimes accèdent via Google Search Console
  • ============================================================================
  • Notes pour la maintenance:
  • - Toujours utiliser le domaine sans 'www' (alacarte.direct)
  • - Vérifier dans Google Search Console après chaque modification
  • - Tester avec: https://alacarte.direct/robots.txt
  • - Dernière mise à jour: 2025-01-17
  • ============================================================================
Back to top