cyclobility.be
robots.txt

Robots Exclusion Standard data for cyclobility.be

Resource Scan

Scan Details

Site Domain cyclobility.be
Base Domain cyclobility.be
Scan Status Ok
Last Scan2025-10-15T09:17:35+00:00
Next Scan 2025-10-22T09:17:35+00:00

Last Scan

Scanned2025-10-15T09:17:35+00:00
URL https://cyclobility.be/robots.txt
Redirect https://www.cyclobility.be/robots.txt
Redirect Domain www.cyclobility.be
Redirect Base cyclobility.be
Domain IPs 185.86.18.127, 2a00:1c98:1000:1224:0:2:fb8b:2377
Redirect IPs 185.86.18.127, 2a00:1c98:1000:1224:0:2:fb8b:2377
Response IP 185.86.18.127
Found Yes
Hash 193fd5056e7bc377f17c1e3b60607be1f3da1223316156a49b737ea506b3b716
SimHash 03341dd62531

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /*?brand=
Disallow /*?accbrand=
Disallow /*?token=

Other Records

Field Value
sitemap https://www.cyclobility.be/nl/sitemaps-1-sitemap.xml
sitemap https://www.cyclobility.be/fr/sitemaps-1-sitemap.xml
sitemap https://www.cyclobility.be/en/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.cyclobility.be/nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/