dosb.de
robots.txt

Robots Exclusion Standard data for dosb.de

Resource Scan

Scan Details

Site Domain dosb.de
Base Domain dosb.de
Scan Status Ok
Last Scan2024-10-22T04:20:46+00:00
Next Scan 2024-11-21T04:20:46+00:00

Last Scan

Scanned2024-10-22T04:20:46+00:00
URL https://www.dosb.de/robots.txt
Domain IPs 185.88.213.75, 2a00:f48:1008::213:75:10
Response IP 185.88.213.75
Found Yes
Hash 2d211876720d3e3842c1e7fc8b019faf04d05f450a7607cbb28dd1aaacf3c4f7
SimHash 7110c3f275f1

Groups

ahrefsbot

Rule Path
Disallow /

*

Rule Path Comment
Allow / -
Disallow /t3lib/ -
Disallow /typo3/ -
Disallow /typo3conf/ -
Disallow /typo3_src/ -
Allow /typo3conf/ext/ -
Allow /typo3temp/ -
Disallow /*?id=* non-realurl URLs
Disallow /*tx_powermail_pi1 no powermail thanks pages

Comments

  • folders
  • parameters
  • Disallow: /*cHash # no cHash (blockiert aber twitter crawler bei news)