1stchoice.co.uk
robots.txt
Robots Exclusion Standard data for 1stchoice.co.uk
Resource Scan
Scan Details
| Site Domain | 1stchoice.co.uk |
| Base Domain | 1stchoice.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 3/31/2025, 9:10:38 PM |
| Next Scan | 4/14/2025, 9:10:38 PM |
Last Successful Scan
| Scanned | 3/16/2025, 9:09:31 PM |
| URL | https://1stchoice.co.uk/robots.txt |
| Redirect | https://www.1stchoice.co.uk/robots.txt |
| Redirect Domain | www.1stchoice.co.uk |
| Redirect Base | 1stchoice.co.uk |
| Domain IPs | 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91 |
| Redirect IPs | 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91 |
| Response IP | 172.66.40.111 |
| Found | Yes |
| Hash | 13c9a1543c1dca62f670feeff5463ea11f269f6e9c510f68843d8abb521b03a9 |
| SimHash | c9468713f511 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /PartLinks.aspx |
| Disallow | /cdn-cgi/ |
| Disallow | /cdn-cgi/rum |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.1stchoice.co.uk/sitemap.xml |
| sitemap | https://www.1stchoice.co.uk/sitemap.xml |
Warnings
- 6 invalid lines.