Log In Sign Up

petit-bateau.de
robots.txt

Robots Exclusion Standard data for petit-bateau.de

Resource Scan

Scan Details

Site Domain petit-bateau.de
Base Domain petit-bateau.de
Scan Status Ok
Last Scan2024-05-30T23:00:58+00:00
Next Scan 2024-06-13T23:00:58+00:00

Last Scan

Scanned2024-05-30T23:00:58+00:00
URL https://www.petit-bateau.de/robots.txt
Domain IPs 108.139.10.101, 108.139.10.30, 108.139.10.49, 108.139.10.85
Response IP 18.165.171.85
Found Yes
Hash c29819848c3c24f57f29173ae0b016cb339b83461a987a7974dc36da5dd5b60e
SimHash 05e2dae2c6d4

Groups

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker

Rule Path
Disallow /

googlebot

Rule Path
Disallow */1000
Disallow /AddProductToWishlist*
Disallow /*?cgid*
Disallow /*?dwvar*
Allow /*?dwvar*size*
Disallow /*view*
Disallow /*prefn*
Disallow /*prefv*
Disallow /on/demandware.store/*
Disallow /on/demandware.static/Sites-PB_FR-Site/*
Allow /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg*
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js*
Allow /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$
Allow /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$
Disallow *%2B*
Disallow /?q=*
Disallow /*sz%3D*
Allow /*?start=*&sz=36$
Disallow /*pmin*
Disallow /*pmax*
Disallow /*srule*
Allow *?srule=rank1&start=*
Disallow /*pid*
Disallow /*variation*
Disallow */filtre/*
Disallow /votre-bon-de-livraison*
Disallow /vos-avoirs*
Disallow /mein-personlicher-bereich/meine-bestellungen*
Disallow /authentifizierung*
Disallow /votre-facture*
Disallow /anmeldung*
Disallow /fehler-seite*
Disallow /warenkorb*
Disallow /bestatigung*
Disallow /lieferung*
Disallow /identifizierung*
Disallow /bezahlung*
Disallow /bestellbestatigung*
Disallow /anmeldung-wieder-auf-lager*
Disallow /konto-anlegen*
Disallow /mein-personlicher-bereich*
Disallow /zurucksetzung-passwort-bestatigung*
Disallow /zurucksetzung-passwort*
Disallow /mein-personlicher-bereich*
Disallow /private-sales*
Disallow /suchen*
Disallow /zur-wunschliste-hinzufugen*
Disallow /ajax/
Disallow /*?cmp=
Disallow /*bvstate%3D*
Disallow /control/product/
Disallow /*?refiningId=*
Disallow /noname-*/LINK
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert*
Disallow /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry*
Disallow /*?fdid=*
Disallow /*/null
Disallow /*/insert
Disallow *?itemsperpage=*
Disallow *?reset=true*

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /*?dwvar_*
Allow *?src=jp*
Allow *?lgw_code=*
Back to top

Other Records

Field Value
sitemap https://www.petit-bateau.de/sitemap_index.xml
Back to top

Comments

  • New directives 09/11/2020
Back to top

Warnings

  • 2 invalid lines.
Back to top