swedishface.co.uk
robots.txt
Robots Exclusion Standard data for swedishface.co.uk
Resource Scan
Scan Details
Site Domain | swedishface.co.uk |
Base Domain | swedishface.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-26T21:27:25+00:00 |
Next Scan | 2025-10-10T21:27:25+00:00 |
Last Successful Scan
Scanned | 2025-08-19T20:08:14+00:00 |
URL | https://swedishface.co.uk/robots.txt |
Redirect | https://swedishface.com/robots.txt |
Redirect Domain | swedishface.com |
Redirect Base | swedishface.com |
Domain IPs | 104.21.27.238, 172.67.169.211, 2606:4700:3030::6815:1bee, 2606:4700:3032::ac43:a9d3 |
Redirect IPs | 104.21.33.237, 172.67.151.174, 2606:4700:3032::ac43:97ae, 2606:4700:3035::6815:21ed |
Response IP | 104.21.33.237 |
Found | Yes |
Hash | 4afb03f80aa4a5a32eabed1f0b0715c9cf26cf9a0d5c3b434bda96405cdaf4b6 |
SimHash | 593d79c4c213 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
*
Rule | Path |
---|---|
Disallow | /*?route=account%2Flogin |
Disallow | /*?route=account%2Fregister |
Disallow | /*?route=account%2Fsimpleregister |
Disallow | /*?route=account%2Faccount |
Disallow | /*?route=checkout%2Fcart |
Disallow | /*?route=checkout%2Fcheckout |
Disallow | /*?route=account%2Feditorder |
Disallow | /index.php?route=account%2Feditorder |
Disallow | /*?route=product%2Fsearch |
Disallow | /index.php?route=product%2Fproduct%2Freview |
Disallow | /*?route=product%2Fproduct%2Freview |
Disallow | /*?*sort* |
Disallow | /*?*order* |
Disallow | /*?*limit* |
Disallow | /presentkort |
Disallow | /erbjudanden |
Disallow | /kassa |
Disallow | /sitemap |
Disallow | /account |
Disallow | /login |
Disallow | /order-historik |
Disallow | /nyhetsbrev |
Disallow | /forgotten-password |
Disallow | /dina-nedladdningar |
Disallow | /returns |
Disallow | /transactions |
Disallow | /order-historik |