bazelmans.com
robots.txt

Robots Exclusion Standard data for bazelmans.com

Resource Scan

Scan Details

Site Domain bazelmans.com
Base Domain bazelmans.com
Scan Status Ok
Last Scan2025-08-28T19:26:15+00:00
Next Scan 2025-09-27T19:26:15+00:00

Last Scan

Scanned2025-08-28T19:26:15+00:00
URL https://bazelmans.com/robots.txt
Redirect https://www.bazelmans.com/robots.txt
Redirect Domain www.bazelmans.com
Redirect Base bazelmans.com
Domain IPs 104.21.56.203, 172.67.187.220, 2606:4700:3033::6815:38cb, 2606:4700:3034::ac43:bbdc
Redirect IPs 104.21.56.203, 172.67.187.220, 2606:4700:3033::6815:38cb, 2606:4700:3034::ac43:bbdc
Response IP 104.21.56.203
Found Yes
Hash fb312c02c9b2aa3de321f84c72657f1208bc3025fd7971b969914440cdf5f197
SimHash e1621c526fb3

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.bazelmans.com/nl/sitemaps-2-sitemap.xml
sitemap https://www.bazelmans.com/en/sitemaps-2-sitemap.xml

Comments

  • robots.txt for https://www.bazelmans.com/nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/