petit-bateau.it
robots.txt

Robots Exclusion Standard data for petit-bateau.it

Resource Scan

Scan Details

Site Domain petit-bateau.it
Base Domain petit-bateau.it
Scan Status Ok
Last Scan2024-11-13T11:24:14+00:00
Next Scan 2024-11-27T11:24:14+00:00

Last Scan

Scanned2024-11-13T11:24:14+00:00
URL https://www.petit-bateau.it/robots.txt
Domain IPs 54.230.112.116, 54.230.112.24, 54.230.112.38, 54.230.112.46
Response IP 13.226.2.111
Found Yes
Hash bbcc01c1c5204c371c3b6b4ddd56871d38cc3c50f1489d0421aaf5bcb370e14c
SimHash 01e2dae2c618

Groups

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker

Rule Path
Disallow /

googlebot

Rule Path
Disallow /AddProductToWishlist*
Disallow */1000
Disallow /*?cgid*
Disallow /*?dwvar*
Allow /*?dwvar*size*
Disallow /*view*
Disallow /*prefn*
Disallow /*prefv*
Disallow /on/demandware.store/*
Disallow /on/demandware.static/Sites-PB_FR-Site/*
Allow /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg*
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js*
Allow /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$
Disallow *%2B*
Disallow /?q=*
Disallow /*sz%3D*
Allow /*?start=*&sz=36$
Disallow /*pmin*
Disallow /*pmax*
Disallow /*srule*
Allow *?srule=rank1&start=*
Disallow /*pid*
Disallow /*variation*
Disallow /filtre/
Disallow /aggiungi-alla-wishlist*
Disallow /ricerca*
Disallow /vendite-private*
Disallow /il-mio-account-fedelta*
Disallow /collegamento*
Disallow /autenticazione*
Disallow /errore-pagina*
Disallow /carrello*
Disallow /conferma*
Disallow /consegna*
Disallow /identificazione*
Disallow /pagamento*
Disallow /conferma-ordine*
Disallow /iscrizione-reso-in-stock*
Disallow /creazione-account*
Disallow /reset-password*
Disallow /area-personale*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /*/null
Disallow /*/insert
Disallow *?itemsperpage=*
Disallow *?reset=true*

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Allow *?src=jp*
Allow *?lgw_code=*

Other Records

Field Value
sitemap https://www.petit-bateau.it/sitemap_index.xml

Comments

  • New directives 09/11/2020

Warnings

  • 2 invalid lines.