petit-bateau.be
robots.txt

Robots Exclusion Standard data for petit-bateau.be

Resource Scan

Scan Details

Site Domain petit-bateau.be
Base Domain petit-bateau.be
Scan Status Ok
Last Scan2024-06-11T11:08:56+00:00
Next Scan 2024-06-25T11:08:56+00:00

Last Scan

Scanned2024-06-11T11:08:56+00:00
URL https://www.petit-bateau.be/robots.txt
Domain IPs 18.173.121.12, 18.173.121.125, 18.173.121.25, 18.173.121.73
Response IP 3.160.246.75
Found Yes
Hash e338d702708356cfe3d20d4d72738aeaa08ac11403ec400ec4b927029eb89ece
SimHash 05eadac24718

Groups

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker

Rule Path
Disallow /

googlebot

Rule Path
Disallow */1000
Disallow /fr/authentification*
Disallow /fr/mon-espace-personnel*
Disallow /fr/reinitialisation-password*
Disallow /fr/inscription-retour-en-stock*
Disallow /fr/confirmation-commande*
Disallow /fr/identification*
Disallow /fr/paiement*
Disallow /fr/panier*
Disallow /fr/connexion*
Disallow /fr/mon-compte-fidelite*
Disallow /fr/votre-bon-de-livraison*
Disallow /fr/recherche*
Disallow /AddProductToWishlist*
Disallow /*?cgid*
Disallow /*?dwvar*
Allow /*?dwvar*size*
Disallow /*view*
Disallow /*prefn*
Disallow /*prefv*
Disallow /on/demandware.store/*
Disallow /on/demandware.static/Sites-PB_FR-Site/*
Allow /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg*
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js*
Allow /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$
Disallow *%2B*
Disallow /?q=*
Disallow /*sz%3D*
Allow /*?start=*&sz=36$
Disallow /erreur-page*
Disallow /*pmin*
Disallow /*pmax*
Disallow /*srule*
Allow *?srule=rank1&start=*
Disallow /*pid*
Disallow /*variation*
Disallow /filtre/
Disallow /nl/authentificatie*
Disallow /nl/mijn-persoonlijke-account*
Disallow /nl/error-pagina*
Disallow /nl/opzoeking*
Disallow /nl/aanmaak-account*
Disallow /nl/verbinding*
Disallow /nl/winkelmandje*
Disallow /nl/identificatie*
Disallow /nl/herinitialisatie-wachtwoord*
Disallow /nl/aanmaak-account*
Disallow /nl/inschrijving-retour-in-voorraad*
Disallow /nl/betaling*
Disallow /nl/levering*
Disallow /nl/bevestiging*
Disallow /nl/mijn-account-getrouwheid*
Disallow /nl/prive-verkoop*
Disallow /nl/product-toevoegen-aan-verlanglijst*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /s/boutique/
Disallow /*/null
Disallow /*/insert
Disallow *?reset=true*

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Allow *?src=jp*
Allow *?lgw_code=*

Other Records

Field Value
sitemap https://www.petit-bateau.be/fr/sitemap_index.xml
sitemap https://www.petit-bateau.be/nl/sitemap_index.xml

Comments

  • New directives 09/11/2020

Warnings

  • 2 invalid lines.