Log In Sign Up

petit-bateau.es
robots.txt

Robots Exclusion Standard data for petit-bateau.es

Resource Scan

Scan Details

Site Domain petit-bateau.es
Base Domain petit-bateau.es
Scan Status Ok
Last Scan2024-06-20T00:27:42+00:00
Next Scan 2024-07-04T00:27:42+00:00

Last Scan

Scanned2024-06-20T00:27:42+00:00
URL https://www.petit-bateau.es/robots.txt
Domain IPs 18.154.132.120, 18.154.132.27, 18.154.132.54, 18.154.132.58
Response IP 3.160.246.96
Found Yes
Hash 23a4f55d3fc8f3327ed0ff8aada19db1bb1ff16b4beaee2be0b6e4c2e21739b2
SimHash 0be2da46c65c

Groups

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker

Rule Path
Disallow /

googlebot

Rule Path
Disallow */1000
Disallow /AddProductToWishlist*
Disallow /*?cgid*
Disallow /*?dwvar*
Allow /*?dwvar*size*
Disallow /*view*
Disallow /*prefn*
Disallow /*prefv*
Disallow /on/demandware.store/*
Disallow /on/demandware.static/Sites-PB_FR-Site/*
Allow /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg*
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js*
Allow /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$
Disallow *%2B*
Disallow /?q=*
Disallow /*sz%3D*
Allow /*?start=*&sz=36$
Disallow /*pmin*
Disallow /*pmax*
Disallow /*srule*
Allow *?srule=rank1&start=*
Disallow /*pid*
Disallow /*variation*
Disallow /filtre/
Disallow /mi-espacio/*
Disallow /autenticacion*
Disallow /confirmacion-pedido*
Disallow /restablecer-contrasena*
Disallow /identificacion*
Disallow /cesta*
Disallow /envio*
Disallow /anadir-articulo-a-la-wishlist*
Disallow /restablecer-contrasena-validacion*
Disallow /confirmacion*
Disallow /pago*
Disallow /error-pagina*
Disallow /conexion*
Disallow /mi-cuenta-fidelidad*
Disallow /ventas-privadas*
Disallow /busqueda*
Disallow /creacion-de-cuenta*
Disallow /restablecer-contrasena*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /*/null

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Disallow /*pid*
Disallow /*variation*
Disallow /filtre/
Disallow /mi-espacio/*
Disallow /authentication*
Disallow /confirmacion-pedido*
Disallow /restablecer-contrasena*
Disallow /payment*
Disallow /identificacion*
Disallow /cesta*
Disallow /envio*
Disallow /anadir-articulo-a-la-wishlist*
Disallow /restablecer-contrasena-validacion*
Disallow /confirmacion*
Disallow /pago*
Disallow /error-pagina*
Disallow /conexion*
Disallow /mi-cuenta-fidelidad*
Disallow /ventas-privadas*
Disallow /busqueda*
Disallow /creacion-de-cuenta*
Disallow /restablecer-contrasena*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /*/null
Disallow /*/insert
Disallow *?reset=true*

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Allow *?src=jp*
Allow *?lgw_code=*
Back to top

Other Records

Field Value
sitemap https://www.petit-bateau.es/sitemap_index.xml*
sitemap https://www.petit-bateau.es/sitemap_index.xml
Back to top

Comments

  • New directives 09/11/2020
  • New directives 09/11/2020
Back to top

Warnings

  • 2 invalid lines.
Back to top