sportprogesundheit.de
robots.txt

Robots Exclusion Standard data for sportprogesundheit.de

Resource Scan

Scan Details

Site Domain sportprogesundheit.de
Base Domain sportprogesundheit.de
Scan Status Ok
Last Scan2024-06-12T13:09:36+00:00
Next Scan 2024-07-12T13:09:36+00:00

Last Scan

Scanned2024-06-12T13:09:36+00:00
URL http://sportprogesundheit.de/robots.txt
Redirect https://gesundheit.dosb.de/robots.txt
Redirect Domain gesundheit.dosb.de
Redirect Base dosb.de
Domain IPs 185.88.213.75
Redirect IPs 185.88.213.75
Response IP 185.88.213.75
Found Yes
Hash 2d211876720d3e3842c1e7fc8b019faf04d05f450a7607cbb28dd1aaacf3c4f7
SimHash 7110c3f275f1

Groups

ahrefsbot

Rule Path
Disallow /

*

Rule Path Comment
Allow / -
Disallow /t3lib/ -
Disallow /typo3/ -
Disallow /typo3conf/ -
Disallow /typo3_src/ -
Allow /typo3conf/ext/ -
Allow /typo3temp/ -
Disallow /*?id=* non-realurl URLs
Disallow /*tx_powermail_pi1 no powermail thanks pages

Comments

  • folders
  • parameters
  • Disallow: /*cHash # no cHash (blockiert aber twitter crawler bei news)