stsft.nhs.uk
robots.txt
Robots Exclusion Standard data for stsft.nhs.uk
Resource Scan
Scan Details
| Site Domain | stsft.nhs.uk |
| Base Domain | stsft.nhs.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-25T15:02:48+00:00 |
| Next Scan | 2024-10-25T15:02:48+00:00 |
Last Scan
| Scanned | 2024-09-25T15:02:48+00:00 |
| URL | https://stsft.nhs.uk/robots.txt |
| Redirect | https://www.stsft.nhs.uk/robots.txt |
| Redirect Domain | www.stsft.nhs.uk |
| Redirect Base | stsft.nhs.uk |
| Domain IPs | 185.217.42.77 |
| Redirect IPs | 185.181.196.36, 2a02:21a8:0:3::f166:b2e4 |
| Response IP | 185.181.196.36 |
| Found | Yes |
| Hash | f9c9a206785fb241c212cf68ba8ee477a9f322ce8a8d37b0c499a169a9ed7ed7 |
| SimHash | 8a6bfa624b39 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ccm/* |
| Disallow | /application/files |
| Disallow | /application/files/* |
| Allow | /application/files/thumbnails |
| Allow | /application/files/*.png |
| Allow | /application/files/*.jpg |
| Disallow | /download_file |
| Disallow | /download_file/* |
| Disallow | /demo |
| Disallow | /demo/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Comments