data.spatialhub.scot
robots.txt

Robots Exclusion Standard data for data.spatialhub.scot

Resource Scan

Scan Details

Site Domain data.spatialhub.scot
Base Domain spatialhub.scot
Scan Status Ok
Last Scan2025-08-02T17:16:48+00:00
Next Scan 2025-09-01T17:16:48+00:00

Last Scan

Scanned2025-08-02T17:16:48+00:00
URL https://data.spatialhub.scot/robots.txt
Domain IPs 15.197.211.1, 3.33.221.202
Response IP 3.33.221.202
Found Yes
Hash e5692a133e1e9afafb7ce555a0d4cb8807a4895537c21028661835e8b3c9bb77
SimHash 4d30cc20a202

Groups

*

Rule Path
Disallow /dataset/rate/
Disallow /revision/
Disallow /dataset/*/history
Disallow /api/

Other Records

Field Value
crawl-delay 10