ecotools.be
robots.txt

Robots Exclusion Standard data for ecotools.be

Resource Scan

Scan Details

Site Domain ecotools.be
Base Domain ecotools.be
Scan Status Ok
Last Scan2025-12-08T19:38:35+00:00
Next Scan 2026-01-07T19:38:35+00:00

Last Scan

Scanned2025-12-08T19:38:35+00:00
URL https://ecotools.be/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132, 83.217.93.55
Response IP 151.101.2.132
Found Yes
Hash 6273427ccfbeaba0bd0c4a0996a42b8f2837bc06d60229f9db7cb601f901db82
SimHash 0b7fdb78f593

Groups

*

Rule Path
Allow /
Disallow /*/q/*_ASC*
Disallow /*/q/*_DESC*
Disallow /checkout
Disallow /cart
Disallow /*aandrijving%3D*
Disallow /*aansluiting%3D*
Disallow /*aantal_tanden%3D*
Disallow /*asgat%3D*
Disallow /*breedte%3D*
Disallow /*categorie%3D*
Disallow /*color%3D*
Disallow /*diameter%3D*
Disallow /*Dikte%3D*
Disallow /*draad%3D*
Disallow /*geschikt_voor%3D*
Disallow /*Hoogte%3D*
Disallow /*Inhoud%3D*
Disallow /*Klembereik%3D*
Disallow /*Klemdiepte%3D*
Disallow /*korrel%3D*
Disallow /*kwasttype%3D*
Disallow /*lengte%3D*
Disallow /*maat%3D*
Disallow /*materiaal%3D*
Disallow /*materiaaldikte_tot%3D*
Disallow /*merk%3D*
Disallow /*plugtype%3D*
Disallow /*price%3D*
Disallow /*Radius%3D*
Disallow /*Schacht%3D*
Disallow /*schroefkop%3D*
Disallow /*toepassing%3D*
Disallow /*type_beitel%3D*
Disallow /*type_frees%3D*

Other Records

Field Value
crawl-delay 25

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

speedyspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ecotools.be/sitemaps/sitemap_ecotools_be.xml
sitemap https://ecotools.be/sitemaps/sitemap_ecotools_be_fr.xml

Comments

  • Website Sitemap
  • Crawlers Setup
  • Paths used by Magento's sorting or layered navigation
  • ----------------------------------------------------
  • Block bad crawlers
  • ----------------------------------------------------
  • third party search engine bot
  • Web-crawler by the company 'WiseGuys' to gather unstructured webdata
  • Chinese Search Engine
  • Russian Search Engine