petit-bateau.co.uk
robots.txt
Robots Exclusion Standard data for petit-bateau.co.uk
Resource Scan
Scan Details
| Site Domain | petit-bateau.co.uk |
| Base Domain | petit-bateau.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-26T09:01:13+00:00 |
| Next Scan | 2024-10-10T09:01:13+00:00 |
Last Scan
| Scanned | 2024-09-26T09:01:13+00:00 |
| URL | https://www.petit-bateau.co.uk/robots.txt |
| Domain IPs | 18.161.97.13, 18.161.97.34, 18.161.97.55, 18.161.97.77 |
| Response IP | 18.165.122.110 |
| Found | Yes |
| Hash | 5fa91c8ab65f09d4771201778bac007a80bfa52f7e2e2b856908bf211b27d6dc |
| SimHash | 0ce3da724658 |
Groups
baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
pagechecker
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | */1000 |
| Disallow | /AddProductToWishlist* |
| Disallow | /*?cgid* |
| Disallow | /*?dwvar* |
| Allow | /*?dwvar*size* |
| Disallow | /*view* |
| Disallow | /*prefn* |
| Disallow | /*prefv* |
| Disallow | /on/demandware.store/* |
| Disallow | /on/demandware.static/Sites-PB_FR-Site/* |
| Allow | /on/demandware.static/Sites-PB_*/-/*/*/images/*.svg* |
| Allow | /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js* |
| Allow | /on/demandware.static/Sites-PB_*/-/default/*/images/*.svg |
| Allow | /on/demandware.static/Sites-PB_*/-/*_*/v*/images/*.png |
| Allow | /on/demandware.static/Sites-PB_*/-/*_*/v*/*.css$ |
| Allow | /on/demandware.static/Sites-PB_*/-/*_*/v*/*.js$ |
| Disallow | *%2B* |
| Disallow | /?q=* |
| Disallow | /*sz%3D* |
| Allow | /*?start=*&sz=36$ |
| Disallow | /*pmin* |
| Disallow | /*pmax* |
| Disallow | /*srule* |
| Allow | *?srule=rank1&start=* |
| Disallow | /*pid* |
| Disallow | /*variation* |
| Disallow | /filtre/ |
| Disallow | /my-account* |
| Disallow | /authentication* |
| Disallow | /create-account* |
| Disallow | /set-new-password* |
| Disallow | /payment* |
| Disallow | /identification* |
| Disallow | /cart* |
| Disallow | /shipping* |
| Disallow | /back-in-stock-add-customer-to-list* |
| Disallow | /order-confirmation* |
| Disallow | /submit* |
| Disallow | /error-page* |
| Disallow | /login* |
| Disallow | /my-loyalty-account* |
| Disallow | /private-sale* |
| Disallow | /search* |
| Disallow | /ajax/ |
| Disallow | /*?cmp= |
| Disallow | /*bvstate%3D* |
| Disallow | /control/product/ |
| Disallow | /*?refiningId=* |
| Disallow | /noname-*/LINK |
| Disallow | /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftcert* |
| Disallow | /on/demandware.static/-/Library-Sites-SharedPetitBateauLibrary/*/*giftregistry* |
| Disallow | /*?fdid=* |
| Disallow | /*/null |
| Disallow | /*/insert |
| Disallow | *?reset=true* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.petit-bateau.co.uk/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments