nl.vivara.be
robots.txt

Robots Exclusion Standard data for nl.vivara.be

Resource Scan

Scan Details

Site Domain nl.vivara.be
Base Domain vivara.be
Scan Status Ok
Last Scan2025-03-26T08:43:59+00:00
Next Scan 2025-04-25T08:43:59+00:00

Last Scan

Scanned2025-03-26T08:43:59+00:00
URL https://nl.vivara.be/robots.txt
Redirect https://www.nl.vivara.be/robots.txt
Redirect Domain www.nl.vivara.be
Redirect Base vivara.be
Domain IPs 94.76.242.85
Response IP 94.76.242.85
Found Yes
Hash eb7711db9f7a9292ee7b5834dd0c4828b9fd267c11da7693d0248fa05c9f0950
SimHash 123561ca03da

Groups

*

Rule Path
Allow /
Disallow /customer/
Disallow /wishlist/
Disallow /checkout/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /onestepcheckout/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /var/
Allow /*?p=
Disallow /*?*
Disallow /*?product_list_order=
Disallow /*?specifications_pimcore_suitablebirdtype=
Disallow /*?specifications_pimcore_material=
Disallow /*?specifications_pimcore_colours=
Disallow /*?specifications_pimcore_holesize=
Disallow /*?am_on_sale=
Disallow /*?price=
Disallow /*?food_ingredients=
Disallow /*?suitable_feeding_method=
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /package.json
Disallow /RELEASE_NOTES.txt
Disallow /*.sample
Disallow /*.git
Disallow /*.cvs
Disallow /*.zip$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$

httrack

Rule Path
Disallow /

pathdefender

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

qihoobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

screaming frog

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

custo

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

newspointbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

abonti

Rule Path
Disallow /

buibui-bot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

zyklop

Rule Path
Disallow /

bubing

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

jsoup

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

domain re-animator

Rule Path
Disallow /

admantx

Rule Path
Disallow /

qcrawl

Rule Path
Disallow /

bhcbot

Rule Path
Disallow /

getintentcrawler

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nl.vivara.be/media/sitemap/vivara-nlbe.xml

Comments

  • Directories
  • Parameters
  • Files
  • Specific Crawlers