vab.be
robots.txt

Robots Exclusion Standard data for vab.be

Resource Scan

Scan Details

Site Domain vab.be
Base Domain vab.be
Scan Status Ok
Last Scan2026-02-06T16:08:24+00:00
Next Scan 2026-03-08T16:08:24+00:00

Last Scan

Scanned2026-02-06T16:08:24+00:00
URL https://vab.be/robots.txt
Domain IPs 84.199.66.5
Response IP 84.199.66.5
Found Yes
Hash 87ccf452075afbeca5e9a40e2247b89b43e753ec44937e4466183ab7e5a25d2b
SimHash 6b8d82c26394

Groups

apis-google
mediapartners-google
adsbot-google-mobile
adsbot-google
googlebot-image
googlebot
googlebot-news
googlebot-video

Rule Path
Disallow

bingbot
msnbot
msnbot-media

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /Design/VAB/css/
Disallow /Design/VAB/js/
Disallow /Design/VAB/images/
Disallow /Design/VAB/site_images/
Disallow /Design/VAB/swf/
Disallow /Design
Disallow /Errorpages
Disallow /~/media/images/
Disallow /WebResource.axd
Disallow /*aankoop-popup
Disallow /VabOnline/Resources/css/
Disallow /vabonline/resources/css/
Disallow /Tyreshop/css/

ia_archiver
mj12bot
mj12bot
semrushbot-sa
semrushbot
ahrefsbot

Rule Path
Disallow /

Warnings

  • 5 invalid lines.