argento.co.uk
robots.txt

Robots Exclusion Standard data for argento.co.uk

Resource Scan

Scan Details

Site Domain argento.co.uk
Base Domain argento.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-02-26T12:15:36+00:00
Next Scan 2024-05-26T12:15:36+00:00

Last Successful Scan

Scanned2022-03-15T19:58:05+00:00
URL http://argento.co.uk/robots.txt
Redirect https://www.argento.com/robots.txt
Redirect Domain www.argento.com
Redirect Base argento.com
Response IP 13.107.213.59
Found Yes
Hash 202ffe4eb4449313e85c93bbaa3a9906a8d33ea895fca2120305e3307dce8015
SimHash e30c9cf0ee72

Groups

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /Secure

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /AjaxScripts

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://argento.com/Sitemap.aspx

Comments

  • robots.txt for CommerceEngine