gerstaecker.de
robots.txt

Robots Exclusion Standard data for gerstaecker.de

Resource Scan

Scan Details

Site Domain gerstaecker.de
Base Domain gerstaecker.de
Scan Status Ok
Last Scan2025-09-30T13:43:36+00:00
Next Scan 2025-10-30T13:43:36+00:00

Last Scan

Scanned2025-09-30T13:43:36+00:00
URL https://gerstaecker.de/robots.txt
Redirect https://www.gerstaecker.de/robots.txt
Redirect Domain www.gerstaecker.de
Redirect Base gerstaecker.de
Domain IPs 116.202.199.129, 5.9.34.36
Redirect IPs 116.202.199.129, 5.9.34.36
Response IP 5.9.34.36
Found Yes
Hash b77788754d45aa5b1307c0ff6c22f47008776d1c40c9ce860e82f8dbebef6cd9
SimHash 203c5dd8dcff

Groups

*

Rule Path
Disallow /admin/
Disallow /core/
Disallow /tmp/
Disallow /views/
Disallow /setup/
Disallow /log/
Disallow /warenkorb/
Disallow /rechnungs-und-lieferadresse/
Disallow /mein-konto/
Disallow /zahlungsart/
Disallow /bestellung-abschliessen/
Disallow /vielen-dank/
Disallow /meine-merkzettel/
Disallow /mein-wunschzettel/
Disallow /konto-eroeffnen/
Disallow /passwort-vergessen/
Disallow /EXCEPTION_LOG.txt
Disallow *cl%3D
Disallow *sessionGUID
Disallow *force_sid%3D
Disallow /*?cur=
Disallow /*%26cur
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D

pinterestbot
facebookexternalhit
meta-webindexer
meta-externalads
meta-externalfetcher
facebookbot

Rule Path
Disallow /admin/
Disallow /core/
Disallow /tmp/
Disallow /views/
Disallow /setup/
Disallow /log/
Disallow /warenkorb/
Disallow /rechnungs-und-lieferadresse/
Disallow /mein-konto/
Disallow /zahlungsart/
Disallow /bestellung-abschliessen/
Disallow /vielen-dank/
Disallow /meine-merkzettel/
Disallow /mein-wunschzettel/
Disallow /konto-eroeffnen/
Disallow /passwort-vergessen/
Disallow /EXCEPTION_LOG.txt
Disallow *cl%3D
Disallow *sessionGUID
Disallow *force_sid%3D
Disallow /*?cur=
Disallow /*%26cur
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gerstaecker.de/sitemaps/sitemap_gerstaecker.de.xml
sitemap https://www.gerstaecker.de/sitemaps/sitemap_images_gerstaecker.de.xml
sitemap https://www.gerstaecker.de/sitemaps/sitemap_content_gerstaecker.de.xml

Comments

  • www.gerstaecker.de
  • wildcards at the end, because of some crawlers see it as error