Log In Sign Up

xenos.be
robots.txt

Robots Exclusion Standard data for xenos.be

Resource Scan

Scan Details

Site Domain xenos.be
Base Domain xenos.be
Scan Status Ok
Last Scan2025-09-19T05:38:27+00:00
Next Scan 2025-10-19T05:38:27+00:00

Last Scan

Scanned2025-09-19T05:38:27+00:00
URL https://xenos.be/robots.txt
Redirect https://www.xenos.be/robots.txt
Redirect Domain www.xenos.be
Redirect Base xenos.be
Domain IPs 104.26.12.209, 104.26.13.209, 172.67.71.82, 2606:4700:20::681a:cd1, 2606:4700:20::681a:dd1, 2606:4700:20::ac43:4752
Redirect IPs 104.26.12.209, 104.26.13.209, 172.67.71.82, 2606:4700:20::681a:cd1, 2606:4700:20::681a:dd1, 2606:4700:20::ac43:4752
Response IP 104.26.13.209
Found Yes
Hash 8311647fee0fb8bf11df616622efb1176ffdfd0f038cb338fc781087af13b08d
SimHash 28109d5427d0

Groups

googlebot

Rule Path
Disallow
Disallow /*?grid=*
Disallow /*%26grid%3D*
Disallow /*?sort=*
Disallow /*%26sort%3D*
Disallow /vendor/*
Disallow /customer/*
Disallow /admin/*
Disallow /checkout/*
Disallow /vergelijken/*
Disallow /print/*

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

*

Rule Path
Disallow /*?grid=*
Disallow /*%26grid%3D*
Disallow /*?sort=*
Disallow /*%26sort%3D*
Disallow /vendor/*
Disallow /customer/*
Disallow /admin/*
Disallow /checkout/*
Disallow /vergelijken/*
Disallow /print/*
Back to top

Other Records

Field Value
sitemap https://www.xenos.nl/storage/sitemap/default/sitemap.xml
sitemap https://www.xenos.be/storage/sitemap/xenos_be/sitemap.xml
Back to top

Comments

  • Crawlers Setup
  • Website Sitemap
  • No crawling!
Back to top