spatialhub.scot
robots.txt
Robots Exclusion Standard data for spatialhub.scot
Resource Scan
Scan Details
| Site Domain | spatialhub.scot |
| Base Domain | spatialhub.scot |
| Scan Status | Ok |
| Last Scan | 2025-08-11T08:36:21+00:00 |
| Next Scan | 2025-09-10T08:36:21+00:00 |
Last Scan
| Scanned | 2025-08-11T08:36:21+00:00 |
| URL | https://spatialhub.scot/robots.txt |
| Redirect | https://data.spatialhub.scot:443/robots.txt |
| Redirect Domain | data.spatialhub.scot |
| Redirect Base | spatialhub.scot |
| Domain IPs | 13.134.125.215, 13.43.55.189, 18.134.72.117 |
| Redirect IPs | 15.197.211.1, 3.33.221.202 |
| Response IP | 15.197.211.1 |
| Found | Yes |
| Hash | e5692a133e1e9afafb7ce555a0d4cb8807a4895537c21028661835e8b3c9bb77 |
| SimHash | 4d30cc20a202 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dataset/rate/ |
| Disallow | /revision/ |
| Disallow | /dataset/*/history |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |