Log In Sign Up

neowebcar.com
robots.txt

Robots Exclusion Standard data for neowebcar.com

Resource Scan

Scan Details

Site Domain neowebcar.com
Base Domain neowebcar.com
Scan Status Ok
Last Scan2024-10-29T19:00:14+00:00
Next Scan 2024-11-28T19:00:14+00:00

Last Scan

Scanned2024-10-29T19:00:14+00:00
URL https://www.neowebcar.com/robots.txt
Redirect https://www.leboncoin.fr/robots.txt
Redirect Domain www.leboncoin.fr
Redirect Base leboncoin.fr
Domain IPs 51.38.34.140
Redirect IPs 3.165.82.25, 3.165.82.84, 3.165.82.85, 3.165.82.9
Response IP 3.165.82.9
Found Yes
Hash 6c1824a59cba85add5561aa46b69e062497237b463789bbd7aabe1e8044b190b
SimHash 799557cc03f4

Groups

googlebot
googlebot-mobile
yahoo! slurp
slurp
slurp
msnbot
bingbot
ia_archiver

Rule Path
Allow /aide.htm
Allow /aide_pro.htm
Allow /livres
Allow /linge_de_maison
Disallow /ai
Disallow /cp
Disallow /support
Disallow /account
Disallow /account/index.html
Disallow /dc/decisions_de_justice
Disallow /dc/accessibilite
Disallow /annonce
Disallow /classified/latest/
Allow /annonces
Disallow /vi/*
Disallow /li
Disallow /*/*.htm
Disallow /ad/animaux/*
Disallow /ad/animaux_perdus/*
Disallow /ad/autres/*
Disallow /*/vacancier/
Disallow /*/demandes
Disallow /*th%3D0
Disallow /aw
Disallow /st
Disallow /maintenance.html
Disallow /pub
Disallow /report-abuse
Disallow /profile/
Disallow /oauth2callback
Disallow /recherche
Disallow /boutique/*/*print%3D0
Disallow /boutique/*.htm?*ca=*_k&*
Disallow /popup_siege_social.htm
Disallow /dc/popup_siege_social
Disallow /*_mediametrie
Allow /boutique*
Allow /*/*.html
Disallow /*/bonnes_affaires
Allow /f/*
Allow /v/*
Disallow /partners/*
Allow /partners/sofinco*
Disallow /messages/*
Allow /*

adsbot-google
adsbot-google-mobile

Rule Path
Allow /aide.htm
Allow /aide_pro.htm
Allow /livres
Allow /linge_de_maison
Disallow /ai
Disallow /cp
Disallow /support
Disallow /account
Disallow /account/index.html
Disallow /dc/decisions_de_justice
Disallow /dc/accessibilite
Disallow /annonce
Disallow /classified/latest/
Allow /annonces
Disallow /vi/*.htm
Disallow /li
Disallow /*/vacancier/
Disallow /*/demandes
Disallow /*th%3D0
Disallow /aw
Disallow /st
Disallow /maintenance.html
Disallow /pub
Disallow /report-abuse
Disallow /profile/
Disallow /oauth2callback
Disallow /boutique/*/*print%3D0
Disallow /boutique/*.htm?*ca=*_k&*
Disallow /popup_siege_social.htm
Disallow /dc/popup_siege_social
Disallow /*_mediametrie
Allow /boutique*
Allow /*/*.html
Disallow /*/*.htm
Disallow /*/bonnes_affaires/
Disallow /f/*
Allow /*

mediapartners-google

Rule Path
Allow /*

proximic

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.leboncoin.fr/auto-main.xml
Back to top

Comments

  • It's forbidden to use search robots or other automatic methods to access Leboncoin.fr.
  • Access is only permitted with special permission from Leboncoin.fr.
  • Bots friendly
  • friendly exceptions
  • www2 only
  • Adviews
  • Holidays calendar pages
  • Bloquage des Demandes
  • all
  • Blocage des /Recherche (Rav)
  • on autorise boutiques (.htm)
  • on autorise les html
  • Pages filtres
  • Gestion villes
  • Partners
  • Messaging
  • AdsBot-Google and AdsBot-Google-Mobile
  • friendly exceptions
  • www2 only
  • Adviews
  • Holidays calendar pages
  • Bloquage des Demandes
  • all
  • on autorise boutiques (.htm)
  • on autorise les html
  • on bloque les annonces avec et sans parametres
  • Allow specific Ads Googlebot to access all our pages
  • Allow proximic to access all our pages
  • Allow CHATGPT Bot to access all our pages
  • Link to the sitemap index file
Back to top