clatterbridgecc.nhs.uk
robots.txt
Robots Exclusion Standard data for clatterbridgecc.nhs.uk
Resource Scan
Scan Details
Site Domain | clatterbridgecc.nhs.uk |
Base Domain | clatterbridgecc.nhs.uk |
Scan Status | Ok |
Last Scan | 2024-10-29T21:39:23+00:00 |
Next Scan | 2024-11-28T21:39:23+00:00 |
Last Scan
Scanned | 2024-10-29T21:39:23+00:00 |
URL | https://clatterbridgecc.nhs.uk/robots.txt |
Redirect | https://www.clatterbridgecc.nhs.uk/robots.txt |
Redirect Domain | www.clatterbridgecc.nhs.uk |
Redirect Base | clatterbridgecc.nhs.uk |
Domain IPs | 45.145.101.43 |
Redirect IPs | 104.20.10.133, 104.20.11.133, 2606:4700:10::6814:a85, 2606:4700:10::6814:b85 |
Response IP | 104.20.11.133 |
Found | Yes |
Hash | 7e833a969a4bd3a78a1ebc9ec51f85742c55969daae7480f89b61b78096cc93b |
SimHash | 0b6bdee2cf80 |
Groups
*
Rule | Path |
---|---|
Disallow | /application/files |
Disallow | /application/files/* |
Disallow | /download_file |
Disallow | /download_file/* |
Disallow | /demo |
Disallow | /demo/* |
Allow | /application/files/thumbnails |
Allow | /application/files/thumbnails/* |
Allow | /application/files/*.png |
Allow | /application/files/*.jpg |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments