bol.com
robots.txt
Robots Exclusion Standard data for bol.com
Resource Scan
Scan Details
| Site Domain | bol.com |
| Base Domain | bol.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T21:12:33+00:00 |
| Next Scan | 2024-11-20T21:12:33+00:00 |
Last Scan
| Scanned | 2024-11-13T21:12:33+00:00 |
| URL | https://bol.com/robots.txt |
| Redirect | https://www.bol.com/robots.txt |
| Redirect Domain | www.bol.com |
| Redirect Base | bol.com |
| Domain IPs | 34.36.121.47 |
| Redirect IPs | 23.215.7.13, 23.215.7.24 |
| Response IP | 23.215.7.24 |
| Found | Yes |
| Hash | ffaf2abdb451b7508a55ccd08e1a66c746e801d35f4c2726887911c091126834 |
| SimHash | e0dacd660d43 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /atg/commerce/order/purchase/ |
| Disallow | /common/error/* |
| Disallow | /nl/fr/ |
| Disallow | /be/fr/p/-/* |
| Disallow | /*/account/ |
| Disallow | /*/ajax/jsLogging.html |
| Disallow | /*/albert-heijn-premium |
| Disallow | /*/b/*/*%2B*/ |
| Disallow | /*/b/*/*/*/ |
| Disallow | /*/bltg/* |
| Disallow | /*/contactformulier* |
| Disallow | /*/c/*/*/ |
| Allow | /*/c/*/*%2B8299/$ |
| Allow | /*/c/*/*%2B3132/$ |
| Allow | /*/c/*/*%2B3133/$ |
| Allow | /*/b/*/*%2B8299/$ |
| Allow | /*/b/*/*%2B3132/$ |
| Allow | /*/b/*/*%2B3133/$ |
| Disallow | /*/ebook/preview.html* |
| Disallow | /*/order/ |
| Disallow | /*/lijstjes/* |
| Disallow | /*/prijsoverzicht/ |
| Disallow | /*/productaanbevelingen/ |
| Disallow | /*/producten-vergelijken/ |
| Disallow | /*/ra/ |
| Disallow | /*/rnwy/account/ |
| Disallow | /*/rnwy/ajax/* |
| Disallow | /*/rnwy/artikelen/ |
| Disallow | /*/rnwy/product_compare/ |
| Disallow | /*/rnwy/product/reviews/ |
| Disallow | /*/rnwy/slots/ajax/* |
| Disallow | /*/rnwy/studybooks/ |
| Disallow | /*/s/ |
| Disallow | /*/schrijf-een-review/ |
| Disallow | /*/sdl/ |
| Allow | /*/sdl/shop-de-look |
| Disallow | /*/select*?* |
| Disallow | /*/select-cadeau-sparen/?* |
| Disallow | /*/serie/*/ |
| Disallow | /*/u/ |
| Disallow | /*/w/*/ |
| Disallow | /*/vaak-samen-gekocht/ |
| Disallow | /*/*%2B*%2B*%2B* |
| Disallow | /*?page=*&promo |
| Disallow | /*offerType%3Drefurbished* |
| Disallow | /*/url$ |
| Disallow | /*/%40type$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bol.com/sitemap/nl-nl/ |
| sitemap | https://www.bol.com/sitemap/nl-be/ |
| sitemap | https://www.bol.com/sitemap/fr-be/ |
Comments