siebenbuerger.de
robots.txt

Robots Exclusion Standard data for siebenbuerger.de

Resource Scan

Scan Details

Site Domain siebenbuerger.de
Base Domain siebenbuerger.de
Scan Status Ok
Last Scan2025-05-31T09:48:51+00:00
Next Scan 2025-06-07T09:48:51+00:00

Last Scan

Scanned2025-05-31T09:48:51+00:00
URL https://siebenbuerger.de/robots.txt
Redirect https://www.siebenbuerger.de/robots.txt
Redirect Domain www.siebenbuerger.de
Redirect Base siebenbuerger.de
Domain IPs 217.160.0.194
Redirect IPs 217.160.0.194
Response IP 217.160.0.194
Found Yes
Hash 769005e8207b3c6fce56cab4333e7f9112fa6d783cce23cc4767c4985e7d1782
SimHash a87cb5c3f915

Groups

*

Rule Path
Disallow /logs/
Disallow /css/
Disallow /ftp/
Disallow /logfileanalyse/
Disallow /zeitung/artikel/drucken/
Disallow /zeitung/newsletter/aktion.php
Disallow /benutzer/aktion.php
Disallow /ortschaften/*.pdf$

msnbot

Rule Path
Disallow /cgi-bin/ubb/ubbcount.cgi
Disallow /sws/phtml/adr_contact.php
Disallow /webshop/

slurp

Rule Path
Disallow /cgi-bin/ubb/ubbcount.cgi
Disallow /sws/phtml/adr_contact.php
Disallow /webshop/

googlebot

Rule Path
Disallow /sws/phtml/adr_contact.php
Disallow /webshop/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • folgende Verzeichnisse sind vom Indexieren durch Suchrobots ausgeschlossen
  • alle robots von diesen verzeichnissen fernhalten