Log In Sign Up

best-for-compaction.de
robots.txt

Robots Exclusion Standard data for best-for-compaction.de

Resource Scan

Scan Details

Site Domain best-for-compaction.de
Base Domain best-for-compaction.de
Scan Status Ok
Last Scan2025-07-21T08:17:52+00:00
Next Scan 2025-07-28T08:17:52+00:00

Last Scan

Scanned2025-07-21T08:17:52+00:00
URL http://best-for-compaction.de/robots.txt
Redirect https://www.bomag.com/robots.txt
Redirect Domain www.bomag.com
Redirect Base bomag.com
Domain IPs 2001:8d8:100f:f000::21a, 217.160.0.253
Redirect IPs 2003:f7:4044:1:80:149:249:6, 80.149.249.6
Response IP 80.149.249.6
Found Yes
Hash 51b59fe86348652d9a5b5eee57d76a0dafcd5f440faedad4db3c68fe8572eee1
SimHash 24793573c5f4

Groups

*

Rule Path
Disallow *tx_solr*
Disallow *%5C?q=*
Disallow /dam/
Disallow /void-*
Back to top

Comments

  • Disallow crawling search queries and internal Solr arguments (filter, etc.)
  • Disallow crawling of DAM assets
  • disallow all urls starting with "/void-*" as those languages are only used for TYPO3 internals
  • and should not be indexed by any robots
Back to top