pharma-food.de
robots.txt

Robots Exclusion Standard data for pharma-food.de

Resource Scan

Scan Details

Site Domain pharma-food.de
Base Domain pharma-food.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-23T04:57:06+00:00
Next Scan 2024-10-22T04:57:06+00:00

Last Successful Scan

Scanned2024-06-25T04:53:57+00:00
URL https://pharma-food.de/robots.txt
Redirect https://www.pharma-food.de:443/robots.txt
Redirect Domain www.pharma-food.de
Redirect Base pharma-food.de
Domain IPs 18.66.102.106, 18.66.102.16, 18.66.102.21, 18.66.102.67
Redirect IPs 18.155.68.3, 18.155.68.31, 18.155.68.53, 18.155.68.88
Response IP 18.155.68.88
Found Yes
Hash 2bc39e07ba8a22a668e1ef3a77e6c8f8a1750ccd6299a0bb3e6c643b0da0fc59
SimHash 596c0f1429a3

Groups

claudebot
searchmetricsbot

Rule Path
Disallow *

*

Rule Path
Disallow /check/
Disallow /contao/
Disallow /system/
Disallow /templates/
Disallow /vendor/
Disallow /share/index.php
Disallow /build.xml
Disallow /composer.json
Disallow /composer.lock
Disallow /README.md
Disallow /serp.html
Disallow /serp/serp-heftarchiv.html
Disallow /reader-preview/
Disallow /files/content/_heftarchiv/
Disallow /files/content/noindex/
Disallow /oeffentliches-profil/letzte-kommentare/
Disallow */feed/
Disallow /api/
Disallow /login.html
Disallow /logout.html
Disallow /*?p=*
Disallow /*?cat=*
Disallow /*?s=*
Disallow /player/*
Disallow /*error.php*
Disallow /reader.html
Disallow /*?sc_*
Disallow /*%26sc_*
Disallow /*?emi=*
Disallow /*%26emi%3D*

Other Records

Field Value
sitemap https://www.pharma-food.de/sitemap-index.xml
sitemap https://markt.pharma-food.de/sitemap.default.xml

Comments

  • robots-pf.txt