chemietechnik.de
robots.txt

Robots Exclusion Standard data for chemietechnik.de

Resource Scan

Scan Details

Site Domain chemietechnik.de
Base Domain chemietechnik.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-25T11:17:35+00:00
Next Scan 2024-10-24T11:17:35+00:00

Last Successful Scan

Scanned2024-06-27T11:15:50+00:00
URL https://chemietechnik.de/robots.txt
Redirect https://www.chemietechnik.de:443/robots.txt
Redirect Domain www.chemietechnik.de
Redirect Base chemietechnik.de
Domain IPs 52.222.214.119, 52.222.214.37, 52.222.214.51, 52.222.214.76
Redirect IPs 13.33.30.117, 13.33.30.3, 13.33.30.40, 13.33.30.97
Response IP 13.33.30.97
Found Yes
Hash 5cd38149d2155a54b9092e2b273492a169d35b081c1d214dca4d96868257fa90
SimHash 5968080ca9bb

Groups

claudebot
searchmetricsbot

Rule Path
Disallow *

*

Rule Path
Disallow /check/
Disallow /contao/
Disallow /system/
Disallow /templates/
Disallow /vendor/
Disallow /share/index.php
Disallow /build.xml
Disallow /composer.json
Disallow /composer.lock
Disallow /README.md
Disallow /serp.html
Disallow /serp/serp-heftarchiv.html
Disallow /reader-preview/
Disallow /files/content/_heftarchiv/
Disallow /files/content/noindex/
Disallow /oeffentliches-profil/letzte-kommentare/
Disallow */feed/
Disallow /api/
Disallow /login.html
Disallow /logout.html
Disallow /*?p=*
Disallow /*?cat=*
Disallow /*?s=*
Disallow /player/*
Disallow /*error.php*
Disallow /reader.html
Disallow /*?sc_*
Disallow /*%26sc_*
Disallow /*?emi=*
Disallow /*%26emi%3D*

Other Records

Field Value
sitemap https://www.chemietechnik.de/sitemap-index.xml
sitemap https://markt.chemietechnik.de/sitemap.default.xml

Comments

  • robots-cte.txt