Log In Sign Up

al-imen.com
robots.txt

Robots Exclusion Standard data for al-imen.com

Resource Scan

Scan Details

Site Domain al-imen.com
Base Domain al-imen.com
Scan Status Ok
Last Scan2025-11-20T15:48:43+00:00
Next Scan 2025-12-04T15:48:43+00:00

Last Scan

Scanned2025-11-20T15:48:43+00:00
URL https://al-imen.com/robots.txt
Domain IPs 23.227.38.65
Response IP 23.227.38.65
Found Yes
Hash f6c75be184a1d0d85b0155994d8bb4b8243c0ab1dbf0a2bc067c6ccc08cbb077
SimHash 7a9aaa11a9f4

Groups

*

Rule Path
Disallow /search*
Disallow /*?q=*
Disallow /*?filter.*
Disallow /*?sort_by*
Disallow /*?_pos=
Disallow /*?_sid=
Disallow /*?_ss=
Disallow /*?_fid=
Disallow /*?_ke=
Disallow /*?_v=
Disallow /*?pr_prod_strat=
Disallow /*?pr_rec_id=
Disallow /*?pr_rec_pid=
Disallow /*?pr_ref_pid=
Disallow /*?pr_seq=
Disallow /*?preview_theme_id=*
Disallow /*?section_id=*
Disallow /*?view=*
Disallow /*?variant=
Disallow /*?ref=*
Disallow /*?coupon=*
Disallow /*?affiliate=*
Disallow /*?currency=*
Disallow /*?locale=*
Disallow /*?lang=*
Disallow /*?*phcursor=
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_campaign=
Disallow /*?*utm_term=
Disallow /*?*utm_content=
Disallow /*?*fbclid=
Disallow /*?*gclid=
Disallow /*?*msclkid=
Disallow /*?*ttclid=
Disallow /*?*li_fat_id=
Disallow /*?*mc_cid=
Disallow /*?*mc_eid=
Disallow /*?*yclid=
Disallow /account*
Disallow /orders*
Disallow /checkouts*
Disallow /admin*
Disallow /apps/*
Allow /cart.js
Disallow /cart.json
Disallow /*?*page=*
Allow /
Allow /products/
Allow /collections/
Allow /*.js$
Allow /*.mjs$
Allow /*.css$
Allow /*.json$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$
Allow /*.svg$
Allow /*.woff$
Allow /*.woff2$
Allow /*.ttf$
Allow /cdn/
Allow /s/files/

googlebot

Rule Path
Allow /products/
Allow /collections/
Allow /*.js$
Allow /*.css$
Allow /*.json$

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

google-extended

Rule Path
Allow /products/
Allow /collections/

adsbot-google

Rule Path
Allow /
Allow /*?*gclid=
Allow /*?*utm_*
Disallow /admin*
Disallow /account*

adsbot-google-mobile

Rule Path
Allow /
Allow /*?*gclid=
Allow /*?*utm_*
Disallow /admin*
Disallow /account*

googlebot-image

Rule Path
Allow /products/
Allow /collections/
Allow /cdn/
Allow /s/files/

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

bingbot

Rule Path
Allow /products/
Allow /collections/

adidxbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /products/
Allow /collections/

operabot

Rule Path
Allow /

qwantify

Rule Path
Allow /

seznambot

Rule Path
Allow /

exabot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

bravebot

Rule Path
Allow /

gptbot
chatgpt-user
oai-searchbot
openai-searchbot
oai-productbot
claudebot
claude-user
perplexitybot
perplexity-user
xai-bot
grokbot
ccbot
youbot
bytespider

Rule Path
Allow /products/
Allow /collections/
Disallow /search*
Disallow /*?q=*

facebookexternalhit
facebot
meta-externalagent
instagrambot
twitterbot
linkedinbot
pinterestbot
whatsapp
telegrambot

Rule Path
Allow /products/
Allow /collections/

amazonbot
kelkoobot
idealo-bot
shopmania
bzagent
pricerunner

Rule Path
Allow /products/
Allow /collections/
Back to top

Other Records

Field Value
sitemap https://al-imen.com/sitemap.xml
Back to top

Comments

  • =====================================================================
  • RÈGLES GÉNÉRALES — al-imen.com
  • =====================================================================
  • Bloquer les répertoires langue non pertinents pour ce marchéDisallow: /it/Disallow: /en/Disallow: /es/Disallow: /pt-pt/# Recherche, filtres, tri
  • Paramètres Shopify / tracking / reco / preview / variantes
  • UTM & co (bloqués pour * ; whitelists Ads plus bas)
  • Zones sensibles
  • API / panier
  • Pagination (bloque tout page=)
  • Rendu & médias (Shopify proxie aussi via /cdn/ et /s/files/)
  • =====================================================================
  • GOOGLE — Search + outils + Ads/Shopping/Media
  • =====================================================================
  • AI training opt-in
  • Ads/Shopping : whitelists LP taggées
  • Images / Vidéos / Media Partners
  • =====================================================================
  • MICROSOFT/BING — Search + Ads + Media
  • =====================================================================
  • =====================================================================
  • AUTRES MOTEURS / ASSISTANTS
  • =====================================================================
  • =====================================================================
  • LLM / AGRÉGATEURS (accès utile, training permis)
  • =====================================================================
  • =====================================================================
  • SOCIAL / PREVIEWS / CATALOGS
  • =====================================================================
  • =====================================================================
  • COMPARATEURS / MARKETPLACES (EU/US)
  • =====================================================================
  • =====================================================================
  • SITEMAP SHOPIFY NATIF
  • =====================================================================
Back to top