reifen.de
robots.txt

Robots Exclusion Standard data for reifen.de

Resource Scan

Scan Details

Site Domain reifen.de
Base Domain reifen.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-20T06:20:39+00:00
Next Scan 2025-07-19T06:20:39+00:00

Last Successful Scan

Scanned2025-03-22T05:28:44+00:00
URL https://reifen.de/robots.txt
Redirect https://www.reifen.de/robots.txt
Redirect Domain www.reifen.de
Redirect Base reifen.de
Domain IPs 49.13.41.98
Redirect IPs 49.13.41.98
Response IP 49.13.41.98
Found Yes
Hash cff66e7151d912db2c383b2e8f4a6c8e7e115ec8b42fe6f1baf89d997799ea62
SimHash 2c044e34c601

Groups

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookcatalog/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /
Disallow /spring/
Disallow /api/
Disallow /admin/
Disallow /partner/
Disallow /warenkorb
Disallow /weiterleitung
Disallow /suche
Disallow *?embedded=true
Disallow *redirect?url=
Disallow *?source=
Disallow *?cw=true

Other Records

Field Value
sitemap https://www.reifen.de/sitemapindex.xml