viata.nl
robots.txt

Robots Exclusion Standard data for viata.nl

Resource Scan

Scan Details

Site Domain viata.nl
Base Domain viata.nl
Scan Status Ok
Last Scan2024-09-18T01:32:59+00:00
Next Scan 2024-10-18T01:32:59+00:00

Last Scan

Scanned2024-09-18T01:32:59+00:00
URL https://viata.nl/robots.txt
Redirect https://www.viata.nl/robots.txt
Redirect Domain www.viata.nl
Redirect Base viata.nl
Domain IPs 194.32.153.22, 2a02:5b41:4:407::15
Redirect IPs 194.32.153.22, 2a02:5b41:4:407::15
Response IP 194.32.153.22
Found Yes
Hash 3a04355f082511e3287b91abd45f10b6e2f10a20d8ab600ace4c4bd71cc1c54a
SimHash 43cb44757272

Groups

*

Rule Path
Disallow */account/
Disallow /nl_BE/*
Disallow /fr_BE/*
Disallow /nl_NL/*
Disallow /fr_FR/*
Disallow /de_DE/*
Disallow /en_GB/*
Disallow /es_ES/*
Disallow /it_IT/*
Disallow *attribute_name_*

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow *tipo-di-prodotto
Disallow *fragment?
Disallow */is-favorite/
Disallow *r%3D
Disallow *search
Disallow */webshop/
Disallow *productreview
Disallow *locale
Disallow */add-review/
Disallow */api/
Disallow */stocknotify/
Disallow *path%3D
Disallow *searchQuery
Disallow *order%3D
Disallow *attribute_name
Disallow *hydratant%3D
Disallow *category%3D
Disallow *pack%3D
Disallow *tradetracker*

ubicrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.viata.nl/sitemap-index-nl-nl.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449