viata.be
robots.txt

Robots Exclusion Standard data for viata.be

Resource Scan

Scan Details

Site Domain viata.be
Base Domain viata.be
Scan Status Ok
Last Scan2024-09-17T04:09:15+00:00
Next Scan 2024-10-17T04:09:15+00:00

Last Scan

Scanned2024-09-17T04:09:15+00:00
URL https://viata.be/robots.txt
Redirect https://www.viata.be/robots.txt
Redirect Domain www.viata.be
Redirect Base viata.be
Domain IPs 194.32.153.22, 2a02:5b41:4:407::15
Redirect IPs 194.32.153.22, 2a02:5b41:4:407::15
Response IP 194.32.153.22
Found Yes
Hash 1c94e935dc433181c5483e4be53e0caaef89161c1e67216278cd97d09d63ec6d
SimHash 43cd45757233

Groups

*

Rule Path
Disallow */account/
Disallow /nl_BE/*
Disallow /fr_BE/*
Disallow /nl_NL/*
Disallow /fr_FR/*
Disallow /de_DE/*
Disallow /en_GB/*
Disallow /es_ES/*
Disallow /it_IT/*
Disallow *attribute_name_*

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow *tipo-di-prodotto
Disallow *fragment?
Disallow */is-favorite/
Disallow *r%3D
Disallow *search
Disallow */webshop/
Disallow *productreview
Disallow *locale
Disallow */add-review/
Disallow */api/
Disallow */stocknotify/
Disallow *path%3D
Disallow *searchQuery
Disallow *order%3D
Disallow *attribute_name
Disallow *hydratant%3D
Disallow *category%3D
Disallow *pack%3D
Disallow *tradetracker*

ubicrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.viata.be/sitemap-index-nl-be.xml
sitemap https://www.viata.be/sitemap-index-fr-be.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449