cafu.de
robots.txt

Robots Exclusion Standard data for cafu.de

Resource Scan

Scan Details

Site Domain cafu.de
Base Domain cafu.de
Scan Status Ok
Last Scan2026-01-18T02:34:14+00:00
Next Scan 2026-02-17T02:34:14+00:00

Last Scan

Scanned2026-01-18T02:34:14+00:00
URL https://cafu.de/robots.txt
Redirect https://www.cafu.de/robots.txt
Redirect Domain www.cafu.de
Redirect Base cafu.de
Domain IPs 2001:8d8:100f:f000::2ab, 217.160.0.38
Redirect IPs 2001:8d8:100f:f000::2ab, 217.160.0.38
Response IP 217.160.0.38
Found Yes
Hash 897601bc130b433d5591ff9f430fe78326cbb4e5f20b069b2e950d4ae64d01fd
SimHash a4768d5bcdf5

Groups

*

Rule Path
Allow

Comments

  • Allow access to all files, including assets, so that
  • bots are free to examine the CSS and JS files as well.