tuinafscheiding.nl
robots.txt

Robots Exclusion Standard data for tuinafscheiding.nl

Resource Scan

Scan Details

Site Domain tuinafscheiding.nl
Base Domain tuinafscheiding.nl
Scan Status Ok
Last Scan2024-05-23T17:01:38+00:00
Next Scan 2024-06-22T17:01:38+00:00

Last Scan

Scanned2024-05-23T17:01:38+00:00
URL https://tuinafscheiding.nl/robots.txt
Redirect https://www.tuinafscheiding.nl/robots.txt
Redirect Domain www.tuinafscheiding.nl
Redirect Base tuinafscheiding.nl
Domain IPs 104.26.4.251, 104.26.5.251, 172.67.72.38, 2606:4700:20::681a:4fb, 2606:4700:20::681a:5fb, 2606:4700:20::ac43:4826
Redirect IPs 104.26.4.251, 104.26.5.251, 172.67.72.38, 2606:4700:20::681a:4fb, 2606:4700:20::681a:5fb, 2606:4700:20::ac43:4826
Response IP 104.26.4.251
Found Yes
Hash 6d36ced2407f9d00fe5aa9cfae342a5ba90fa49652394322356bda19792cc558
SimHash 5521ae285eb7

Groups

*

Rule Path
Disallow *?vdt_materiaalsoort
Disallow *?vdt_zichtdichtheid
Disallow *?vdt_lengte
Disallow *?vdt_hoogte
Disallow *?price
Disallow *?vdt_in_lite
Disallow *?vdt_afmetingen_hxb
Disallow *?vdt_afwerking
Disallow *?vdt_dikteplank
Disallow *?vdt_breedte
Disallow *?vdt_kleur
Disallow *?q
Disallow *%26vdt_materiaalsoort
Disallow *%26vdt_zichtdichtheid
Disallow *%26vdt_dikteplank
Disallow *%26vdt_lengte
Disallow *%26vdt_hoogte
Disallow *%26price
Disallow *%26vdt_in_lite
Disallow *%26vdt_afmetingen_hxb
Disallow *%26vdt_afwerking
Disallow *%26vdt_kleur
Disallow *%26vdt_breedte
Disallow *?dir
Disallow *%26dir
Disallow *?limit
Disallow *%26limit
Disallow *?select
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /sales/
Disallow /wishlist/
Disallow /customer/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /index.php/
Disallow /sendfriend/
Disallow /checkout/
Disallow *?gclid
Disallow *?&gid
Disallow *.php$
Disallow *?SID
Disallow /*?___SID
Disallow *?cache
Disallow *.CVS
Disallow *.Zip$
Disallow *.Svn$
Disallow *.Idea$
Disallow *.Sql$
Disallow *.Tgz$
Allow /*media/

Comments

  • do not crawl sorting parameters
  • Do not crawl directories
  • do not crawl default Magento URLs
  • do not crawl utm tags, sessions id's and other
  • do not CVS, SVN directory and dump files
  • Allow all images

Warnings

  • 2 invalid lines.