beslist.be
robots.txt
Robots Exclusion Standard data for beslist.be
Resource Scan
Scan Details
| Site Domain | beslist.be |
| Base Domain | beslist.be |
| Scan Status | Ok |
| Last Scan | 2024-11-15T04:30:19+00:00 |
| Next Scan | 2024-11-22T04:30:19+00:00 |
Last Scan
| Scanned | 2024-11-15T04:30:19+00:00 |
| URL | https://beslist.be/robots.txt |
| Redirect | https://www.beslist.be/robots.txt |
| Redirect Domain | www.beslist.be |
| Redirect Base | beslist.be |
| Domain IPs | 18.161.111.29, 18.161.111.42, 18.161.111.83, 18.161.111.99 |
| Redirect IPs | 13.226.2.3, 13.226.2.6, 13.226.2.84, 13.226.2.95 |
| Response IP | 3.164.68.37 |
| Found | Yes |
| Hash | 7e929c3e0607cc3e25dcb66a26b9fb633e07579030d8c8c76ee23e3b8eeba844 |
| SimHash | 821bdd5f8613 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /compare/ |
| Disallow | /consumer/ |
| Disallow | /images/ |
| Disallow | /load_product.php |
| Disallow | /outclick/redirect |
| Disallow | /overig/ |
| Disallow | /php/ |
| Disallow | /products/overig/ |
| Disallow | /shoppingcart/ |
| Disallow | /ufah/ |
| Disallow | /webimages/ |
| Disallow | /recently_viewed/ |
| Disallow | /app.php |
| Disallow | /modules/ |
| Disallow | /module/ |
| Disallow | /shopsearch/ |
| Disallow | /data/graphql |
| Disallow | /noindex/ |
| Disallow | /cddvdrom/ |
| Disallow | /computers/ |
| Disallow | /baby_peuter/ |
| Disallow | /meubilair/ |
| Disallow | /eten_drinken/ |
| Disallow | /mode/ |
| Disallow | /software/ |
| Disallow | /huis_tuin/ |
| Disallow | /sport_outdoor_vrije-tijd/ |
| Disallow | /cadeaus_gadgets_culinair/ |
| Disallow | /gezond_mooi/ |
| Disallow | /speelgoed_spelletjes/ |
| Disallow | /sieraden_horloges/ |
| Disallow | /kantoorartikelen/ |
| Disallow | /voor_volwassenen/ |
| Disallow | /elektronica/ |
| Disallow | /films-series/ |
| Disallow | /boeken/ |
| Disallow | /huishoudelijke_apparatuur/ |
| Disallow | /main_sanitair/ |
| Disallow | /parfum_aftershave/ |
| Disallow | /horloge/ |
| Disallow | /muziekinstrument/ |
| Disallow | /schoenen/ |
| Disallow | /mode_accessoires/ |
| Disallow | /dieren_accessoires/ |
| Disallow | /klussen/ |
| Disallow | /tuin_accessoires/ |
| Disallow | /autos/ |
| Disallow | /fietsen/ |
| Disallow | /accessoires/ |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /compare/ |
| Disallow | /consumer/ |
| Disallow | /images/ |
| Disallow | /load_product.php |
| Disallow | /outclick/redirect |
| Disallow | /overig/ |
| Disallow | /php/ |
| Disallow | /products/overig/ |
| Disallow | /shoppingcart/ |
| Disallow | /ufah/ |
| Disallow | /webimages/ |
| Disallow | /recently_viewed/ |
| Disallow | /app.php |
| Disallow | /modules/ |
| Disallow | /module/ |
| Disallow | /shopsearch/ |
| Disallow | /data/graphql |
| Disallow | /noindex/ |
| Disallow | /cddvdrom/ |
| Disallow | /computers/ |
| Disallow | /baby_peuter/ |
| Disallow | /meubilair/ |
| Disallow | /eten_drinken/ |
| Disallow | /mode/ |
| Disallow | /software/ |
| Disallow | /huis_tuin/ |
| Disallow | /sport_outdoor_vrije-tijd/ |
| Disallow | /cadeaus_gadgets_culinair/ |
| Disallow | /gezond_mooi/ |
| Disallow | /speelgoed_spelletjes/ |
| Disallow | /sieraden_horloges/ |
| Disallow | /kantoorartikelen/ |
| Disallow | /voor_volwassenen/ |
| Disallow | /elektronica/ |
| Disallow | /films-series/ |
| Disallow | /boeken/ |
| Disallow | /huishoudelijke_apparatuur/ |
| Disallow | /main_sanitair/ |
| Disallow | /parfum_aftershave/ |
| Disallow | /horloge/ |
| Disallow | /muziekinstrument/ |
| Disallow | /schoenen/ |
| Disallow | /mode_accessoires/ |
| Disallow | /dieren_accessoires/ |
| Disallow | /klussen/ |
| Disallow | /tuin_accessoires/ |
| Disallow | /autos/ |
| Disallow | /fietsen/ |
| Disallow | /accessoires/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.beslist.be/sitemapxml/be/current/sitemap-category-index.xml |
| sitemap | https://www.beslist.be/sitemapxml/be/current/sitemap-browse-index.xml |
| sitemap | https://www.beslist.be/sitemapxml/be/current/sitemap-landing-index.xml |