dgt.nhs.uk
robots.txt
Robots Exclusion Standard data for dgt.nhs.uk
Resource Scan
Scan Details
| Site Domain | dgt.nhs.uk |
| Base Domain | dgt.nhs.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-28T12:49:56+00:00 |
| Next Scan | 2024-11-27T12:49:56+00:00 |
Last Scan
| Scanned | 2024-10-28T12:49:56+00:00 |
| URL | https://dgt.nhs.uk/robots.txt |
| Redirect | https://www.dgt.nhs.uk/robots.txt |
| Redirect Domain | www.dgt.nhs.uk |
| Redirect Base | dgt.nhs.uk |
| Domain IPs | 80.66.201.19 |
| Redirect IPs | 80.66.201.19 |
| Response IP | 80.66.201.19 |
| Found | Yes |
| Hash | fad0ba60b0146000e9c250e96fd7074172856144a123504bec44ff81de1daea0 |
| SimHash | 3a2bf45ac9b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /ccm/system/captcha/picture |
| Disallow | /application/files |
| Disallow | /application/files/* |
| Disallow | /download_file |
| Disallow | /download_file/* |
| Disallow | /concrete |
| Disallow | /concrete/* |
| Disallow | /demo |
| Disallow | /demo/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 50 |
Comments