systemtreff.de
robots.txt

Robots Exclusion Standard data for systemtreff.de

Resource Scan

Scan Details

Site Domain systemtreff.de
Base Domain systemtreff.de
Scan Status Ok
Last Scan2025-08-27T09:00:44+00:00
Next Scan 2025-09-26T09:00:44+00:00

Last Scan

Scanned2025-08-27T09:00:44+00:00
URL https://systemtreff.de/robots.txt
Redirect https://www.systemtreff.de/robots.txt
Redirect Domain www.systemtreff.de
Redirect Base systemtreff.de
Domain IPs 104.26.8.213, 104.26.9.213, 172.67.72.167, 2606:4700:20::681a:8d5, 2606:4700:20::681a:9d5, 2606:4700:20::ac43:48a7
Redirect IPs 104.26.8.213, 104.26.9.213, 172.67.72.167, 2606:4700:20::681a:8d5, 2606:4700:20::681a:9d5, 2606:4700:20::ac43:48a7
Response IP 104.26.8.213
Found Yes
Hash e1b6141b9276e6f0fd2c511669df7a2ddf6ec1839b1b2c4ad0b0235c05d38477
SimHash ad60da382af3

Groups

googlebot-image

Rule Path
Allow /media/image/product/
Disallow /

*

Rule Path
Disallow /navi.php
Disallow /warenkorb.php
Disallow /bestellvorgang.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /pass.php
Disallow /Registrieren
Disallow /Passwort-vergessen
Disallow /Warenkorb
Disallow /newsletter.php
Disallow /Mein-Konto?
Disallow /Bestellvorgang
Disallow /Bestellabschluss
Disallow /registrieren.php
Disallow /dbeS
Disallow /jtl.php
Disallow /wishlist
Disallow /*.pdf$
Disallow /bewertung.php
Disallow /toolsajax.server.php
Disallow /io.php
Disallow /load/*
Disallow /*FPS-Filter*
Disallow /Accueil*
Disallow /Gehaeuse_1*
Disallow /AMD-ELITE-Ryzen-Vega*
Disallow /*_%5B0-9%5D$
Disallow /mkm_*
Disallow /*?k=*
Disallow /*pcfinder*
Disallow /16GB-DDR4
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?limit=%5B1-9%5D%5B0-9%5D*
Disallow /*?mode*
Disallow /Hardware-Zubehoer/*
Disallow /admin/
Disallow /includes/
Disallow /cache/
Disallow /media/
Disallow /vendor/
Disallow /*?a=
Disallow /*%26a%3D
Disallow /*?n=
Disallow /*%26n%3D
Disallow /*?c=
Disallow /*%26c%3D
Disallow /*?f=
Disallow /*%26f%3D
Disallow /*s%5B2-9%5D$
Disallow /*s%5B1-9%5D%5B0-9%5D*$
Disallow /*?sessID=
Disallow /*%26sessID%3D
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*.php$
Disallow /*.cgi$
Disallow /*.pl$
Disallow /*.sh$
Disallow /*.py$
Disallow /suche
Disallow /*?q=
Disallow /*%26q%3D

Other Records

Field Value
sitemap https://www.systemtreff.de/sitemap_www_systemtreff_de.xml

Comments

  • Disallow: /*__*
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl category
  • Typische Ausschlüsse für URL-Muster im JTL-Shop
  • Filter ausschließen (typische Filterparameter)
  • Typische Ausschlüsse für Seitensortierung
  • Weitere Ausschlüsse für session-basierte URLs
  • Vermeidung von Crawling interner Skripte und Technischer Dateien
  • Vermeidung des Crawling dynamischer Suchergebnisse oder Filterkombinationen