chesterfieldroyal.nhs.uk
robots.txt
Robots Exclusion Standard data for chesterfieldroyal.nhs.uk
Resource Scan
Scan Details
| Site Domain | chesterfieldroyal.nhs.uk |
| Base Domain | chesterfieldroyal.nhs.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-22T10:46:48+00:00 |
| Next Scan | 2024-11-21T10:46:48+00:00 |
Last Scan
| Scanned | 2024-10-22T10:46:48+00:00 |
| URL | https://chesterfieldroyal.nhs.uk/robots.txt |
| Redirect | https://www.chesterfieldroyal.nhs.uk/robots.txt |
| Redirect Domain | www.chesterfieldroyal.nhs.uk |
| Redirect Base | chesterfieldroyal.nhs.uk |
| Domain IPs | 185.220.62.187 |
| Redirect IPs | 185.220.62.187 |
| Response IP | 185.220.62.187 |
| Found | Yes |
| Hash | 6ce19686b04409aa1d99bec942d5d880b4018eabcd8584d2784ee06a9ef55dea |
| SimHash | 2e6fdfe2cd24 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /ccm/system/captcha/picture |
| Disallow | /application/files |
| Disallow | /application/files/* |
| Disallow | /download_file |
| Disallow | /download_file/* |
| Disallow | /concrete |
| Disallow | /concrete/* |
| Disallow | /demo |
| Disallow | /demo/* |
| Allow | /application/files/cache/css |
| Allow | /application/files/cache/css/* |
| Allow | /application/files/cache/js |
| Allow | /application/files/cache/js/* |
| Allow | /concrete/css |
| Allow | /concrete/css/* |
| Allow | /concrete/js |
| Allow | /concrete/js/* |
| Allow | /application/files/thumbnails |
| Allow | /application/files/thumbnails/* |
| Allow | /application/files/*.png |
| Allow | /application/files/*.jpg |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments