duvel.be
robots.txt

Robots Exclusion Standard data for duvel.be

Resource Scan

Scan Details

Site Domain duvel.be
Base Domain duvel.be
Scan Status Ok
Last Scan5/20/2025, 12:04:12 PM
Next Scan 5/27/2025, 12:04:12 PM

Last Scan

Scanned5/20/2025, 12:04:12 PM
URL https://duvel.be/robots.txt
Redirect https://www.duvel.com/robots.txt
Redirect Domain www.duvel.com
Redirect Base duvel.com
Domain IPs 104.21.63.58, 172.67.143.220, 2606:4700:3033::ac43:8fdc, 2606:4700:3036::6815:3f3a
Redirect IPs 104.18.24.75, 104.18.25.75, 2606:4700::6812:184b, 2606:4700::6812:194b
Response IP 104.18.25.75
Found Yes
Hash a8bbefa0d5ee1d81207b9bd3d03c127e54ba7567c4a3cf836464419ce047202e
SimHash 61281d5664b3

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.duvel.com/nl-be/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/fr-be/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/nl-nl/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/fr-fr/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/en-gb/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/en-us/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/en/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/es-es/sitemaps-1-sitemap.xml
sitemap https://www.duvel.com/it-it/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.duvel.com/nl-be/
  • live - don't allow web crawlers to index cpresources/ or vendor/