royalfree.nhs.uk
robots.txt
Robots Exclusion Standard data for royalfree.nhs.uk
Resource Scan
Scan Details
| Site Domain | royalfree.nhs.uk |
| Base Domain | royalfree.nhs.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-21T19:27:31+00:00 |
| Next Scan | 2024-09-28T19:27:31+00:00 |
Last Scan
| Scanned | 2024-09-21T19:27:31+00:00 |
| URL | http://www.royalfree.nhs.uk/robots.txt |
| Domain IPs | 104.20.3.193, 104.20.4.193, 2606:4700:10::6814:3c1, 2606:4700:10::6814:4c1 |
| Response IP | 104.20.3.193 |
| Found | Yes |
| Hash | ce970384aa1c30f0c20857e3f6d6aca5a2fbf603f6add3550589a050e5bed0c7 |
| SimHash | 1e4bd46acd10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /ccm/system/captcha/picture |
| Disallow | /application/files |
| Disallow | /application/files/* |
| Disallow | /application/secure_files |
| Disallow | /application/secure_files/* |
| Allow | /application/files/thumbnails |
| Allow | /application/files/*.png |
| Allow | /application/files/*.jpg |
| Disallow | /download_file |
| Disallow | /download_file/* |
| Disallow | /concrete |
| Disallow | /concrete/* |
| Disallow | /demo |
| Disallow | /demo/* |
| Allow | /application/files/cache/css |
| Allow | /application/files/cache/js |
| Allow | /concrete/css |
| Allow | /concrete/js |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments