animalfriends.co.uk
robots.txt
Robots Exclusion Standard data for animalfriends.co.uk
Resource Scan
Scan Details
Site Domain | animalfriends.co.uk |
Base Domain | animalfriends.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-28T03:25:59+00:00 |
Next Scan | 2024-09-26T03:25:59+00:00 |
Last Successful Scan
Scanned | 2023-05-09T13:18:34+00:00 |
URL | https://animalfriends.co.uk/robots.txt |
Redirect | https://www.animalfriends.co.uk/robots.txt |
Redirect Domain | www.animalfriends.co.uk |
Redirect Base | animalfriends.co.uk |
Domain IPs | 13.107.237.59, 13.107.238.59 |
Redirect IPs | 104.16.254.225, 104.16.255.225, 2606:4700::6810:fee1, 2606:4700::6810:ffe1 |
Response IP | 104.16.254.225 |
Found | Yes |
Hash | c7d392c1372098be4ac66e317952a69616faed9dc4c049b848de2ae963d28e47 |
SimHash | 69694256e193 |
Groups
*
Rule | Path |
---|---|
Disallow | /EPiServer.Forms/ |
Disallow | /WebResource.axd |
Disallow | /animalfriends/ |
Disallow | /*?amp |
Disallow | /*?fb* |
Disallow | /*?letters=* |
Disallow | /*?Topics=* |
Disallow | /*?enqe=* |
Disallow | /*?style=* |
Disallow | /*?pet_101=* |
Disallow | /*?ccm_paging* |
Disallow | /*?msclkid=* |
Disallow | /*?gclid=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.animalfriends.co.uk/sitemap.xml |