blackfire.eu
robots.txt
Robots Exclusion Standard data for blackfire.eu
Resource Scan
Scan Details
Site Domain | blackfire.eu |
Base Domain | blackfire.eu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 4/7/2025, 4:40:03 AM |
Next Scan | 4/21/2025, 4:40:03 AM |
Last Successful Scan
Scanned | 2/28/2025, 4:23:08 AM |
URL | https://blackfire.eu/robots.txt |
Redirect | https://www.blackfire.eu/robots.txt |
Redirect Domain | www.blackfire.eu |
Redirect Base | blackfire.eu |
Domain IPs | 152.89.172.56, 2a01:c8:100::54, 2a01:c8:101::55, 2a09:35c0:102::56, 81.92.94.54, 81.92.95.55 |
Redirect IPs | 20.113.43.237 |
Response IP | 20.113.43.237 |
Found | Yes |
Hash | 3a42624932838f1e021b63623d1e8ad7aceebccf8ed956b4b1a475e2056c561f |
SimHash | cd6cf44ce591 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /js |
Disallow | /css |
Disallow | /en-gb/profile/ |
Disallow | /en-gb/shop/ |
Disallow | /en-gb/checkout/ |
Disallow | /de-de/profile/ |
Disallow | /de-de/shop/ |
Disallow | /de-de/checkout/ |
Disallow | /es-es/profile/ |
Disallow | /es-es/shop/ |
Disallow | /es-es/checkout/ |
Disallow | /fr-fr/profile/ |
Disallow | /fr-fr/shop/ |
Disallow | /fr-fr/checkout/ |
Disallow | /it-it/profile/ |
Disallow | /it-it/shop/ |
Disallow | /it-it/checkout/ |
Disallow | /content/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.blackfire.eu/sitemap.xml |
Warnings
- `visit-time` is not a known field.