cnwl.nhs.uk
robots.txt
Robots Exclusion Standard data for cnwl.nhs.uk
Resource Scan
Scan Details
Site Domain | cnwl.nhs.uk |
Base Domain | cnwl.nhs.uk |
Scan Status | Ok |
Last Scan | 2024-09-12T00:11:11+00:00 |
Next Scan | 2024-10-12T00:11:11+00:00 |
Last Scan
Scanned | 2024-09-12T00:11:11+00:00 |
URL | https://cnwl.nhs.uk/robots.txt |
Redirect | https://www.cnwl.nhs.uk/robots.txt |
Redirect Domain | www.cnwl.nhs.uk |
Redirect Base | cnwl.nhs.uk |
Domain IPs | 45.157.41.19 |
Redirect IPs | 45.157.41.19 |
Response IP | 45.157.41.19 |
Found | Yes |
Hash | 31231fe1158ecee6f1cb1d2398b62fd1190c3a75b83c91b7a11628fde7b6284e |
SimHash | 2e4ed7facd60 |
Groups
*
Rule | Path |
---|---|
Allow | /application/files/cache/css |
Allow | /application/files/cache/js |
Allow | /concrete/css |
Allow | /concrete/js |
Disallow | /application/attributes |
Disallow | /application/authentication |
Disallow | /application/bootstrap |
Disallow | /application/config |
Disallow | /application/controllers |
Disallow | /application/elements |
Disallow | /application/helpers |
Disallow | /application/jobs |
Disallow | /application/languages |
Disallow | /application/mail |
Disallow | /application/models |
Disallow | /application/page_types |
Disallow | /application/single_pages |
Disallow | /application/tools |
Disallow | /application/views |
Disallow | /ccm/system/captcha/picture |
Disallow | /application/files |
Disallow | /application/files/* |
Disallow | /download_file |
Disallow | /download_file/* |
Disallow | /concrete |
Disallow | /concrete/* |
Disallow | /demo |
Disallow | /demo/* |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Comments