what0-18.nhs.uk
robots.txt
Robots Exclusion Standard data for what0-18.nhs.uk
Resource Scan
Scan Details
Site Domain | what0-18.nhs.uk |
Base Domain | what0-18.nhs.uk |
Scan Status | Ok |
Last Scan | 2024-09-21T09:57:00+00:00 |
Next Scan | 2024-10-21T09:57:00+00:00 |
Last Scan
Scanned | 2024-09-21T09:57:00+00:00 |
URL | https://what0-18.nhs.uk/robots.txt |
Redirect | https://www.what0-18.nhs.uk/robots.txt |
Redirect Domain | www.what0-18.nhs.uk |
Redirect Base | what0-18.nhs.uk |
Domain IPs | 45.157.40.144 |
Redirect IPs | 104.22.70.250, 104.22.71.250, 172.67.26.187, 2606:4700:10::6816:46fa, 2606:4700:10::6816:47fa, 2606:4700:10::ac43:1abb |
Response IP | 104.22.70.250 |
Found | Yes |
Hash | 2f382a6567961ea7f110e0fb12a82d2896e26b03928e896afd9ce35609f8df84 |
SimHash | 8a4bd66ac910 |
Groups
*
Rule | Path |
---|---|
Disallow | /application/attributes |
Disallow | /application/authentication |
Disallow | /application/bootstrap |
Disallow | /application/config |
Disallow | /application/controllers |
Disallow | /application/elements |
Disallow | /application/helpers |
Disallow | /application/jobs |
Disallow | /application/languages |
Disallow | /application/mail |
Disallow | /application/models |
Disallow | /application/page_types |
Disallow | /application/single_pages |
Disallow | /application/tools |
Disallow | /application/views |
Disallow | /ccm/system/captcha/picture |
Disallow | /application/files |
Disallow | /application/files/* |
Disallow | /application/secure_files |
Disallow | /application/secure_files/* |
Allow | /application/files/thumbnails |
Allow | /application/files/*.png |
Allow | /application/files/*.jpg |
Disallow | /download_file |
Disallow | /download_file/* |
Disallow | /concrete |
Disallow | /concrete/* |
Disallow | /demo |
Disallow | /demo/* |
Allow | /application/files/cache/css |
Allow | /application/files/cache/js |
Allow | /concrete/css |
Allow | /concrete/js |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments