detjer.com
robots.txt

Robots Exclusion Standard data for detjer.com

Resource Scan

Scan Details

Site Domain detjer.com
Base Domain detjer.com
Scan Status Ok
Last Scan2024-06-09T16:37:22+00:00
Next Scan 2024-06-16T16:37:22+00:00

Last Scan

Scanned2024-06-09T16:37:22+00:00
URL https://detjer.com/robots.txt
Redirect https://www.detjer.com/en/robots.txt
Redirect Domain www.detjer.com
Redirect Base detjer.com
Domain IPs 104.21.16.244, 172.67.217.25, 2606:4700:3032::ac43:d919, 2606:4700:3035::6815:10f4
Redirect IPs 104.21.16.244, 172.67.217.25, 2606:4700:3032::ac43:d919, 2606:4700:3035::6815:10f4
Response IP 104.21.16.244
Found Yes
Hash 924f2def818a0e2001fa9599cf203b1198f63b1508aea199d7ce1a9c5ec97dd4
SimHash a1281542f7b5

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /search/?q=
Allow /cpresources/*/jquery.js*
Allow /cpresources/*/ccc*
Allow /cpresources/*/algoliaplus*
Allow /cpresources/*/algoliasearch*
Allow /cpresources/*/hogan.min.js*

Other Records

Field Value
sitemap https://www.detjer.com/en/sitemaps-1-sitemap.xml
sitemap https://www.detjer.com/nl/sitemaps-1-sitemap.xml
sitemap https://www.detjer.com/de/sitemaps-1-sitemap.xml
sitemap https://www.detjer.com/fr/sitemaps-1-sitemap.xml
sitemap https://www.detjer.com/es/sitemaps-1-sitemap.xml
sitemap https://www.detjer.com/it/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.detjer.com/en/
  • live - don't allow web crawlers to index cpresources/ or vendor/