nexco-expertise.com
robots.txt

Robots Exclusion Standard data for nexco-expertise.com

Resource Scan

Scan Details

Site Domain nexco-expertise.com
Base Domain nexco-expertise.com
Scan Status Ok
Last Scan2026-02-04T23:52:36+00:00
Next Scan 2026-03-06T23:52:36+00:00

Last Scan

Scanned2026-02-04T23:52:36+00:00
URL https://nexco-expertise.com/robots.txt
Redirect https://www.nexco-expertise.com/robots.txt
Redirect Domain www.nexco-expertise.com
Redirect Base nexco-expertise.com
Domain IPs 104.21.7.69, 172.67.187.140, 2606:4700:3032::ac43:bb8c, 2606:4700:3035::6815:745
Redirect IPs 104.21.7.69, 172.67.187.140, 2606:4700:3032::ac43:bb8c, 2606:4700:3035::6815:745
Response IP 104.21.7.69
Found Yes
Hash ab76be6ab79a69a68c9a44427f6e78039ac914a0916f98e9f48da64471102ef2
SimHash 441e8b53765a

Groups

*
*

Rule Path Comment
Allow /web/static/ -
Allow /web/assets/ -
Allow /web/image/ -
Allow /web/content/ -
Disallow /web/login -
Disallow /web/signup -
Disallow /web/*/reset_password -
Disallow /website/info -
Disallow /mail/ -
Disallow /im_livechat/ -
Disallow /portal/ -
Disallow /web/ (les Allow ci-dessus priment sur ce Disallow)
Disallow /shop/cart -
Disallow /shop/checkout -
Disallow /shop/compare -
Disallow /shop/wishlist -
Disallow /shop/payment -
Disallow /payment -

googlebot

Rule Path
Allow /

googleother

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

applebot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

dotbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.nexco-expertise.com/sitemap.xml
sitemap https://www.nexco-expertise.com/sitemap.xml
sitemap https://www.nexco-expertise.com/lep/sitemap.xml

Comments

  • custom
  • robots.txt — Nexco (max crawl pour Search, safe pour Odoo)
  • Dernière maj : 2025-10-21
  • PAR DÉFAUT
  • Odoo : autoriser les assets nécessaires au rendu
  • Odoo : bloquer l’admin et les zones privées
  • E-commerce (si activé)
  • MOTEURS DE RECHERCHE (OUVERTS)
  • BOTS SEO / AUDIT (adoucis pour éviter 429)
  • (Google ignore Crawl-delay, mais Ahrefs/Semrush/DotBot/MJ12 le respectent)
  • IA — BLOQUER LE TRAINING MASSIF
  • IA — BOTS "réponse" (RAG) autorisés (optionnel)
  • SITEMAPS