swedishface.co.uk
robots.txt

Robots Exclusion Standard data for swedishface.co.uk

Resource Scan

Scan Details

Site Domain swedishface.co.uk
Base Domain swedishface.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T21:27:25+00:00
Next Scan 2025-10-10T21:27:25+00:00

Last Successful Scan

Scanned2025-08-19T20:08:14+00:00
URL https://swedishface.co.uk/robots.txt
Redirect https://swedishface.com/robots.txt
Redirect Domain swedishface.com
Redirect Base swedishface.com
Domain IPs 104.21.27.238, 172.67.169.211, 2606:4700:3030::6815:1bee, 2606:4700:3032::ac43:a9d3
Redirect IPs 104.21.33.237, 172.67.151.174, 2606:4700:3032::ac43:97ae, 2606:4700:3035::6815:21ed
Response IP 104.21.33.237
Found Yes
Hash 4afb03f80aa4a5a32eabed1f0b0715c9cf26cf9a0d5c3b434bda96405cdaf4b6
SimHash 593d79c4c213

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /*?route=account%2Flogin
Disallow /*?route=account%2Fregister
Disallow /*?route=account%2Fsimpleregister
Disallow /*?route=account%2Faccount
Disallow /*?route=checkout%2Fcart
Disallow /*?route=checkout%2Fcheckout
Disallow /*?route=account%2Feditorder
Disallow /index.php?route=account%2Feditorder
Disallow /*?route=product%2Fsearch
Disallow /index.php?route=product%2Fproduct%2Freview
Disallow /*?route=product%2Fproduct%2Freview
Disallow /*?*sort*
Disallow /*?*order*
Disallow /*?*limit*
Disallow /presentkort
Disallow /erbjudanden
Disallow /kassa
Disallow /sitemap
Disallow /account
Disallow /login
Disallow /order-historik
Disallow /nyhetsbrev
Disallow /forgotten-password
Disallow /dina-nedladdningar
Disallow /returns
Disallow /transactions
Disallow /order-historik

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /