argento.co.uk
robots.txt
Robots Exclusion Standard data for argento.co.uk
Resource Scan
Scan Details
Site Domain | argento.co.uk |
Base Domain | argento.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-02-26T12:15:36+00:00 |
Next Scan | 2024-05-26T12:15:36+00:00 |
Last Successful Scan
Scanned | 2022-03-15T19:58:05+00:00 |
URL | http://argento.co.uk/robots.txt |
Redirect | https://www.argento.com/robots.txt |
Redirect Domain | www.argento.com |
Redirect Base | argento.com |
Response IP | 13.107.213.59 |
Found | Yes |
Hash | 202ffe4eb4449313e85c93bbaa3a9906a8d33ea895fca2120305e3307dce8015 |
SimHash | e30c9cf0ee72 |
Groups
*
Rule | Path |
---|---|
Disallow | /Secure |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | /AjaxScripts |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://argento.com/Sitemap.aspx |
Comments