Log In Sign Up

crm-petitbateau.com
robots.txt

Robots Exclusion Standard data for crm-petitbateau.com

Resource Scan

Scan Details

Site Domain crm-petitbateau.com
Base Domain crm-petitbateau.com
Scan Status Ok
Last Scan2024-04-30T07:04:10+00:00
Next Scan 2024-05-30T07:04:10+00:00

Last Scan

Scanned2024-04-30T07:04:10+00:00
URL http://crm-petitbateau.com/robots.txt
Redirect https://www.petit-bateau.fr/robots.txt
Redirect Domain www.petit-bateau.fr
Redirect Base petit-bateau.fr
Domain IPs 195.64.164.87
Redirect IPs 18.161.6.108, 18.161.6.38, 18.161.6.58, 18.161.6.79
Response IP 3.160.246.126
Found Yes
Hash f24628839f6619086a8263478fc4d8cbb8d6a52f7cd5c22abeab8e6feb170cec
SimHash 0de2ded3e054

Groups

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker

Rule Path
Disallow /

googlebot

Rule Path
Disallow */1000
Disallow /authentification*
Disallow /mon-espace-personnel*
Disallow /reinitialisation-password*
Disallow /inscription-retour-en-stock*
Disallow /confirmation-commande*
Disallow /identification*
Disallow /paiement*
Disallow /panier*
Disallow /connexion*
Disallow /mon-compte-fidelite*
Disallow /votre-bon-de-livraison*
Disallow /recherche*
Disallow /AddProductToWishlist*
Disallow /*?cgid*
Disallow /*?dwvar*
Allow /*?dwvar*size*
Disallow /*view*
Disallow /*prefn*
Disallow /*prefv*
Disallow /on/demandware.store/*
Disallow /on/demandware.static/Sites-PB_FR-Site/*
Allow /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg*
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js*
Allow /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$
Allow /on/demandware.static/Sites-PB_FR-Site/-/default/*/images/favicon/favicon-16x16.png
Allow /on/demandware.static/Sites-PB_FR-Site/-/default/*/images/favicon/apple-touch-icon.png
Allow /on/demandware.static/Sites-PB_FR-Site/-/default/*/images/favicon/favicon-16x16.png
Disallow *%2B*
Disallow /?q=*
Disallow /*sz%3D*
Allow /*?start=*&sz=36$
Disallow /erreur-page*
Disallow /*pmin*
Disallow /*pmax*
Disallow /*srule*
Allow *?srule=rank1&start=*
Disallow /*pid*
Disallow /*variation*
Disallow */filtre/*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /noname*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /s/boutique/
Disallow /*/null
Disallow /*/insert
Disallow *?itemsperpage=*
Disallow *?reset=true*
Disallow */POST

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Allow *?src=jp*
Allow *?lgw_code=*
Back to top

Other Records

Field Value
sitemap https://www.petit-bateau.fr/sitemap_index.xml
Back to top

Comments

  • New directives 09/11/2020
Back to top

Warnings

  • 2 invalid lines.
Back to top