bol.io
robots.txt
Robots Exclusion Standard data for bol.io
Resource Scan
Scan Details
| Site Domain | bol.io |
| Base Domain | bol.io |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-20T20:10:48+00:00 |
| Next Scan | 2024-10-19T20:10:48+00:00 |
Last Successful Scan
| Scanned | 2024-06-22T20:08:55+00:00 |
| URL | https://bol.io/robots.txt |
| Redirect | https://www.bol.com/robots.txt |
| Redirect Domain | www.bol.com |
| Redirect Base | bol.com |
| Domain IPs | 185.14.168.82 |
| Redirect IPs | 34.36.121.47 |
| Response IP | 34.36.121.47 |
| Found | Yes |
| Hash | 73ef08f49977c1b461f4bb2fb0642c2d95baaf558f01fd710b10753555088255 |
| SimHash | e09ac9648d43 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /atg/commerce/order/purchase/ |
| Disallow | /common/error/* |
| Disallow | /nl/fr/ |
| Disallow | /be/fr/p/-/* |
| Disallow | /*/account/ |
| Disallow | /*/ajax/jsLogging.html |
| Disallow | /*/albert-heijn-premium |
| Disallow | /*/b/*/*%2B*/ |
| Disallow | /*/b/*/*/*/ |
| Disallow | /*/bltg/* |
| Disallow | /*/contactformulier* |
| Disallow | /*/c/*/*/ |
| Allow | /*/c/*/*%2B8299/$ |
| Allow | /*/c/*/*%2B3132/$ |
| Allow | /*/c/*/*%2B3133/$ |
| Disallow | /*/ebook/preview.html* |
| Disallow | /*/order/ |
| Disallow | /*/lijstjes/* |
| Disallow | /*/prijsoverzicht/ |
| Disallow | /*/productaanbevelingen/ |
| Disallow | /*/producten-vergelijken/ |
| Disallow | /*/ra/ |
| Disallow | /*/rnwy/account/ |
| Disallow | /*/rnwy/ajax/* |
| Disallow | /*/rnwy/artikelen/ |
| Disallow | /*/rnwy/product_compare/ |
| Disallow | /*/rnwy/product/reviews/ |
| Disallow | /*/rnwy/slots/ajax/* |
| Disallow | /*/rnwy/studybooks/ |
| Disallow | /*/s/ |
| Disallow | /*/schrijf-een-review/ |
| Disallow | /*/sdl/ |
| Allow | /*/sdl/shop-de-look |
| Disallow | /*/select*?* |
| Disallow | /*/select-cadeau-sparen/?* |
| Disallow | /*/serie/*/ |
| Disallow | /*/u/ |
| Disallow | /*/w/*/ |
| Disallow | /*/vaak-samen-gekocht/ |
| Disallow | /*/*%2B*%2B*%2B* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bol.com/sitemap/nl-nl/ |
| sitemap | https://www.bol.com/sitemap/nl-be/ |
| sitemap | https://www.bol.com/sitemap/fr-be/ |
Comments