blackfire.eu
robots.txt

Robots Exclusion Standard data for blackfire.eu

Resource Scan

Scan Details

Site Domain blackfire.eu
Base Domain blackfire.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/7/2025, 4:40:03 AM
Next Scan 4/21/2025, 4:40:03 AM

Last Successful Scan

Scanned2/28/2025, 4:23:08 AM
URL https://blackfire.eu/robots.txt
Redirect https://www.blackfire.eu/robots.txt
Redirect Domain www.blackfire.eu
Redirect Base blackfire.eu
Domain IPs 152.89.172.56, 2a01:c8:100::54, 2a01:c8:101::55, 2a09:35c0:102::56, 81.92.94.54, 81.92.95.55
Redirect IPs 20.113.43.237
Response IP 20.113.43.237
Found Yes
Hash 3a42624932838f1e021b63623d1e8ad7aceebccf8ed956b4b1a475e2056c561f
SimHash cd6cf44ce591

Groups

*

Rule Path
Disallow /admin
Disallow /js
Disallow /css
Disallow /en-gb/profile/
Disallow /en-gb/shop/
Disallow /en-gb/checkout/
Disallow /de-de/profile/
Disallow /de-de/shop/
Disallow /de-de/checkout/
Disallow /es-es/profile/
Disallow /es-es/shop/
Disallow /es-es/checkout/
Disallow /fr-fr/profile/
Disallow /fr-fr/shop/
Disallow /fr-fr/checkout/
Disallow /it-it/profile/
Disallow /it-it/shop/
Disallow /it-it/checkout/
Disallow /content/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.blackfire.eu/sitemap.xml

Warnings

  • `visit-time` is not a known field.