leboncoin.fr
robots.txt

Robots Exclusion Standard data for leboncoin.fr

Resource Scan

Scan Details

Site Domain leboncoin.fr
Base Domain leboncoin.fr
Scan Status Ok
Last Scan2024-06-18T02:02:48+00:00
Next Scan 2024-06-25T02:02:48+00:00

Last Scan

Scanned2024-06-18T02:02:48+00:00
URL https://leboncoin.fr/robots.txt
Redirect https://www.leboncoin.fr/robots.txt
Redirect Domain www.leboncoin.fr
Redirect Base leboncoin.fr
Domain IPs 3.165.82.25, 3.165.82.84, 3.165.82.85, 3.165.82.9
Redirect IPs 3.165.82.25, 3.165.82.84, 3.165.82.85, 3.165.82.9
Response IP 3.165.82.85
Found Yes
Hash 7fbb22640afc19906f775f7da45cea87fd59e453cebd2f11b9200d6560c30c3e
SimHash 799657c887a4

Groups

googlebot
googlebot-mobile
yahoo! slurp
slurp
slurp
msnbot
bingbot
ia_archiver

Rule Path
Allow /aide.htm
Allow /aide_pro.htm
Allow /livres
Allow /linge_de_maison
Disallow /ai
Disallow /cp
Disallow /support
Disallow /account
Disallow /account/index.html
Disallow /dc/decisions_de_justice
Disallow /dc/accessibilite
Disallow /annonce
Disallow /classified/latest/
Allow /annonces
Disallow /vi/*.htm
Disallow /li
Disallow /*/vacancier/
Disallow /*/demandes
Disallow /*th%3D0
Disallow /aw
Disallow /st
Disallow /maintenance.html
Disallow /pub
Disallow /report-abuse
Disallow /profil/
Disallow /oauth2callback
Disallow /recherche
Disallow /boutique/*/*print%3D0
Disallow /boutique/*.htm?*ca=*_k&*
Disallow /popup_siege_social.htm
Disallow /dc/popup_siege_social
Disallow /*_mediametrie
Allow /boutique*
Allow /*/*.html
Disallow /*/*.htm
Allow /chaussures/*.htm
Allow /accessoires_bagagerie/*.htm
Allow /vetements/*.htm
Allow /montres_bijoux/*.htm
Allow /equipement_bebe/*.htm
Allow /vetements_bebe/*.htm
Allow /telephonie/*.htm
Allow /telephones_objets_connectes/*.htm
Disallow /*/bonnes_affaires
Allow /f/*
Allow /v/*
Disallow /partners/*
Allow /partners/sofinco*
Disallow /messages/*
Allow /*

adsbot-google
adsbot-google-mobile

Rule Path
Allow /aide.htm
Allow /aide_pro.htm
Allow /livres
Allow /linge_de_maison
Disallow /ai
Disallow /cp
Disallow /support
Disallow /account
Disallow /account/index.html
Disallow /dc/decisions_de_justice
Disallow /dc/accessibilite
Disallow /annonce
Disallow /classified/latest/
Allow /annonces
Disallow /vi/*.htm
Disallow /li
Disallow /*/vacancier/
Disallow /*/demandes
Disallow /*th%3D0
Disallow /aw
Disallow /st
Disallow /maintenance.html
Disallow /pub
Disallow /report-abuse
Disallow /profil/
Disallow /oauth2callback
Disallow /boutique/*/*print%3D0
Disallow /boutique/*.htm?*ca=*_k&*
Disallow /popup_siege_social.htm
Disallow /dc/popup_siege_social
Disallow /*_mediametrie
Allow /boutique*
Allow /*/*.html
Disallow /*/*.htm
Disallow /*/bonnes_affaires/
Disallow /f/*
Allow /*

mediapartners-google

Rule Path
Allow /*

proximic

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.leboncoin.fr/auto-main.xml

Comments

  • It's forbidden to use search robots or other automatic methods to access Leboncoin.fr.
  • Access is only permitted with special permission from Leboncoin.fr.
  • Bots friendly
  • friendly exceptions
  • www2 only
  • Adviews
  • Holidays calendar pages
  • Bloquage des Demandes
  • all
  • Blocage des /Recherche (Rav)
  • on autorise boutiques (.htm)
  • on autorise les html
  • on bloque les annonces avec et sans parametres
  • Pages filtres
  • Gestion villes
  • Partners
  • Messaging
  • AdsBot-Google and AdsBot-Google-Mobile
  • friendly exceptions
  • www2 only
  • Adviews
  • Holidays calendar pages
  • Bloquage des Demandes
  • all
  • on autorise boutiques (.htm)
  • on autorise les html
  • on bloque les annonces avec et sans parametres
  • Allow specific Ads Googlebot to access all our pages
  • Allow proximic to access all our pages
  • Allow CHATGPT Bot to access all our pages
  • Link to the sitemap index file