centralpoint.be
robots.txt

Robots Exclusion Standard data for centralpoint.be

Resource Scan

Scan Details

Site Domain centralpoint.be
Base Domain centralpoint.be
Scan Status Ok
Last Scan2025-10-26T19:27:35+00:00
Next Scan 2025-11-25T19:27:35+00:00

Last Scan

Scanned2025-10-26T19:27:35+00:00
URL https://centralpoint.be/robots.txt
Redirect https://www.dustin.be/robots.txt
Redirect Domain www.dustin.be
Redirect Base dustin.be
Domain IPs 2600:9000:a41c:83d3:540c:428e:9f44:fcea, 2600:9000:a50d:3b18:f592:3e7:e9a:25d7, 75.2.6.158, 99.83.130.12
Redirect IPs 2600:9000:2912:1800:17:1937:4cc0:93a1, 2600:9000:2912:2800:17:1937:4cc0:93a1, 2600:9000:2912:4a00:17:1937:4cc0:93a1, 2600:9000:2912:6a00:17:1937:4cc0:93a1, 2600:9000:2912:8a00:17:1937:4cc0:93a1, 2600:9000:2912:a00:17:1937:4cc0:93a1, 2600:9000:2912:d200:17:1937:4cc0:93a1, 2600:9000:2912:ee00:17:1937:4cc0:93a1, 3.174.255.119, 3.174.255.128, 3.174.255.63, 3.174.255.95
Response IP 13.226.2.105
Found Yes
Hash fcdbb6c6786e91d2a939fe3c64dac41f14a1c9f7f7fa70ab2a5bd1a582b08b53
SimHash 7a13db56f731

Groups

dynamite data

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow *network%3D
Disallow /ajax.php
Disallow /?page=cart
Disallow /nl/winkelwagen/
Disallow /fr/panier/
Disallow *request%3DminiProduct
Disallow /kiss/
Disallow /*?page=compare
Disallow /nl/rechercher/
Disallow /nl/zoeken/
Disallow /fr/zoeken/
Disallow /fr/rechercher/
Disallow /*?page=search
Disallow /*?search=
Disallow /*/review/
Disallow /*/review
Disallow /*?request=stockReminder
Disallow /*?request=getYoutube
Disallow /*?article=
Disallow /*?famid=
Disallow /*?page=
Disallow /*?pld0page=
Disallow /*?rtv=
Disallow /*?cid=
Disallow /*?ref=
Disallow /*?delete=
Disallow /*?limit_direction_
Disallow /*?t=
Disallow /frame.php?url=
Disallow /*?special=
Disallow /*?Sorting=
Disallow /*?sorting=
Disallow /*?author=
Disallow /*?prodid=
Disallow /*?cat=
Disallow /protected/
Disallow /tracker/
Disallow /*?lang=
Disallow /*?refine
Disallow /*?fromblog=
Disallow /*?review_sort=
Disallow /*?promo=
Disallow /*?oid=
Disallow /*?cameFrom=
Disallow /*?Nr=
Disallow /*?print=
Disallow /*?sms
Disallow /*?amount
Disallow /*?fss=
Disallow /api2/
Disallow /*?facet
Disallow /*?reset
Disallow /static-pages/*
Disallow /error-pages/*
Disallow /node-api/
Disallow /node-elastic/

Other Records

Field Value
sitemap https://www.dustin.be/sitemap_index.xml