foyles.co.uk
robots.txt
Robots Exclusion Standard data for foyles.co.uk
Resource Scan
Scan Details
| Site Domain | foyles.co.uk |
| Base Domain | foyles.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-17T16:05:45+00:00 |
| Next Scan | 2024-12-16T16:05:45+00:00 |
Last Successful Scan
| Scanned | 2023-02-03T11:23:18+00:00 |
| URL | https://www.foyles.co.uk/robots.txt |
| Domain IPs | 104.18.26.206, 104.18.27.206, 2606:4700::6812:1ace, 2606:4700::6812:1bce |
| Response IP | 104.18.26.206 |
| Found | Yes |
| Hash | 33a97d1695d05fbf4870151bd5fe44f19216df92a5b3635f2efed908aee87560 |
| SimHash | c19ccc6064d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Public/ForgottenPassword.aspx |
| Disallow | /Public/JoinMail.aspx |
| Disallow | /Public/Register.aspx |
| Disallow | /Public/ApplyFoyalty.aspx |
| Disallow | /Public/Login.aspx |
| Disallow | /Public/Reserve.aspx?itemId=* |
| Disallow | /results.asp?AUB= |
| Disallow | /addfeature |
| Disallow | /addtxtfeature |
| Disallow | /animatorssurvivalkit.asp? |
| Disallow | /Bargains |
| Disallow | /bargains |
| Disallow | /display.asp?CID= |
| Disallow | /display.asp?CUR= |
| Disallow | /results.asp?kyt= |
| Disallow | /results.asp?BIC= |
| Disallow | /*rowNum* |
| Disallow | /*home%3Dtrue* |
| Disallow | /*/prices-*/ |
| Disallow | /*/available-for-despatch/ |
| Disallow | /*/available-for-immediate-download/ |
| Disallow | /*/available-for-despatch-in-1-business-day/ |
| Disallow | /*/available-for-reservation-in-store/ |
| Disallow | /*/available-for-order/ |
| Disallow | /*/normally-despatched-in-13-weeks/ |
| Disallow | /*/temporarily-unavailable/ |
| Disallow | /*/available-for-preorder/ |
| Disallow | /*/published-in-current-month/ |
| Disallow | /*/published-next-month/ |
| Disallow | /*/published-in-2-months-or-later/ |
| Disallow | /*/available-for-despatch-in-2-business-days/ |
| Disallow | /Public/Shop/Search.aspx* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.foyles.co.uk/sitemaps/sitemap.xml |