collectandgo.be
robots.txt
Robots Exclusion Standard data for collectandgo.be
Resource Scan
Scan Details
| Site Domain | collectandgo.be |
| Base Domain | collectandgo.be |
| Scan Status | Ok |
| Last Scan | 2024-11-07T14:53:29+00:00 |
| Next Scan | 2024-12-07T14:53:29+00:00 |
Last Scan
| Scanned | 2024-11-07T14:53:29+00:00 |
| URL | https://collectandgo.be/robots.txt |
| Redirect | https://www.collectandgo.be/robots.txt |
| Redirect Domain | www.collectandgo.be |
| Redirect Base | collectandgo.be |
| Domain IPs | 91.231.109.154 |
| Redirect IPs | 91.231.109.228 |
| Response IP | 91.231.109.228 |
| Found | Yes |
| Hash | 05178a44a372f15f3502b57d60ddf0e212a4ae9d3842b77004803fe2ac48161d |
| SimHash | 6600fa16c595 |
Groups
*
msnbot
slurp
yahoo! slurp
ingrid
yandexbot
rogerbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /booking/register |
| Disallow | /booking/slot |
| Disallow | /colruyt/fr/checkout |
| Disallow | /colruyt/nl/checkout |
| Disallow | /bioplanet/fr/checkout |
| Disallow | /bioplanet/nl/checkout |
| Disallow | /orderreserve/overview |
| Disallow | /OrderDetail |
| Disallow | /colruyt/fr/MyAccount |
| Disallow | /colruyt/nl/MyAccount |
| Disallow | /bioplanet/fr/MyAccount |
| Disallow | /bioplanet/nl/MyAccount |
| Disallow | /colruyt/nl/xtraprofiel |
| Disallow | /colruyt/fr/xtraprofiel |
| Disallow | /colruyt/fr/profilxtra |
| Disallow | /colruyt/nl/profilxtra |
| Disallow | /colruyt/nl/great-offers |
| Disallow | /colruyt/fr/great-offers |
| Disallow | /colruyt/nl/merchandiserlijstes |
| Disallow | /colruyt/fr/listesdemarchandiseur |
| Disallow | /GenericStaticContentPageLayoutView |
| Disallow | /SearchDisplay |
| Disallow | /CategoryDisplay |
| Disallow | /nl/ecoscore/ |
| Disallow | /fr/ecoscore/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.collectandgo.be/sitemap.xml |