animalfriends.co.uk
robots.txt
Robots Exclusion Standard data for animalfriends.co.uk
Resource Scan
Scan Details
| Site Domain | animalfriends.co.uk |
| Base Domain | animalfriends.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-30T03:24:31+00:00 |
| Next Scan | 2024-06-28T03:24:31+00:00 |
Last Successful Scan
| Scanned | 2023-05-09T13:18:34+00:00 |
| URL | https://animalfriends.co.uk/robots.txt |
| Redirect | https://www.animalfriends.co.uk/robots.txt |
| Redirect Domain | www.animalfriends.co.uk |
| Redirect Base | animalfriends.co.uk |
| Domain IPs | 13.107.237.59, 13.107.238.59 |
| Redirect IPs | 104.16.254.225, 104.16.255.225, 2606:4700::6810:fee1, 2606:4700::6810:ffe1 |
| Response IP | 104.16.254.225 |
| Found | Yes |
| Hash | c7d392c1372098be4ac66e317952a69616faed9dc4c049b848de2ae963d28e47 |
| SimHash | 69694256e193 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /EPiServer.Forms/ |
| Disallow | /WebResource.axd |
| Disallow | /animalfriends/ |
| Disallow | /*?amp |
| Disallow | /*?fb* |
| Disallow | /*?letters=* |
| Disallow | /*?Topics=* |
| Disallow | /*?enqe=* |
| Disallow | /*?style=* |
| Disallow | /*?pet_101=* |
| Disallow | /*?ccm_paging* |
| Disallow | /*?msclkid=* |
| Disallow | /*?gclid=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.animalfriends.co.uk/sitemap.xml |