Log In Sign Up

garantzaden.nl
robots.txt

Robots Exclusion Standard data for garantzaden.nl

Resource Scan

Scan Details

Site Domain garantzaden.nl
Base Domain garantzaden.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-29T11:09:15+00:00
Next Scan 2026-02-27T11:09:15+00:00

Last Successful Scan

Scanned2025-03-20T00:47:40+00:00
URL https://garantzaden.nl/robots.txt
Redirect https://www.garantzaden.nl/robots.txt
Redirect Domain www.garantzaden.nl
Redirect Base garantzaden.nl
Domain IPs 104.21.59.172, 172.67.181.94, 2606:4700:3030::ac43:b55e, 2606:4700:3033::6815:3bac
Redirect IPs 104.21.59.172, 172.67.181.94, 2606:4700:3030::ac43:b55e, 2606:4700:3033::6815:3bac
Response IP 172.67.181.94
Found Yes
Hash f4046d33ebe1a3064dcf905a21244623353a3e7fb29e4e2f8fbf623977acb755
SimHash 2028abc346f1

Groups

*

Rule Path
Disallow /admin/
Disallow /catalogsearch/
Disallow /search/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /checkout/
Disallow /checkout/cart/
Disallow /onestepcheckout/
Disallow /wishlist/
Disallow /sales/guest/form/
Disallow /*?dir=
Disallow /*?mode=
Disallow /*?limit=
Disallow /*?order=
Disallow /*?p=
Disallow /*?SID=
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /media/
Allow /static/
Allow /media/
Disallow /cgi-bin/
Disallow /errors/
Disallow /downloader/
Disallow /report/
Disallow /dev/
Disallow /var/
Disallow /pub/
Disallow /cron.php
Disallow /env.php
Disallow /composer.json
Disallow /composer.lock
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /admin/
Back to top

Other Records

Field Value
sitemap https://www.garantzaden.nl/sitemap.xml
Back to top

Comments

  • robots.txt for www.garantzaden.nl
  • Allow all robots full access
  • Sitemap location
  • Disallow crawling of the admin area
  • Disallow crawling of the search results
  • Disallow crawling of login, register and cart pages (non-SEO friendly pages)
  • Disallow access to any URL parameters for sorting, pagination, filtering, etc.
  • Prevent indexing of search results pages
  • Allow crawling of important pages such as product pages, category pages, etc.
  • Allow all bots to crawl the Magento static and media directories
  • Block irrelevant files and directories
  • Block Magento admin login page for all bots
  • Crawl-delay directive (optional: for slower servers)
  • Crawl-delay: 10
Back to top

Warnings

  • `noindex` is not a known field.
Back to top