veritas.be
robots.txt

Robots Exclusion Standard data for veritas.be

Resource Scan

Scan Details

Site Domain veritas.be
Base Domain veritas.be
Scan Status Ok
Last Scan2025-11-24T21:26:10+00:00
Next Scan 2025-12-24T21:26:10+00:00

Last Scan

Scanned2025-11-24T21:26:10+00:00
URL https://veritas.be/robots.txt
Redirect https://www.veritas.be/nl_be/robots.txt
Redirect Domain www.veritas.be
Redirect Base veritas.be
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.113.124
Found Yes
Hash 99afaa1e0607bf0fa884f96fdb3c4671acde3a55a6a1f18ec0b578b55e339fc3
SimHash e43bd9c9cfb3

Groups

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

npbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

fast

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

*

Rule Path
Allow /*?p=
Disallow /index.php/
Disallow /*?p=*&
Disallow /checkout/
Disallow */index/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow */catalogsearch/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow */uenc/
Disallow */eshop/

Other Records

Field Value
sitemap https://www.veritas.be/media/sitemap/sitemap_nl_be.xml
sitemap https://www.veritas.be/media/sitemap/sitemap_fr_be.xml

Comments

  • Disallow: /*?
  • Disallow: */static/

Warnings

  • 2 invalid lines.