ckan-uat.stage.lz.seed.nsw.gov.au
robots.txt

Robots Exclusion Standard data for ckan-uat.stage.lz.seed.nsw.gov.au

Resource Scan

Scan Details

Site Domain ckan-uat.stage.lz.seed.nsw.gov.au
Base Domain nsw.gov.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan6/13/2025, 11:04:50 AM
Next Scan 9/11/2025, 11:04:50 AM

Last Successful Scan

Scanned7/26/2024, 11:02:56 AM
URL https://ckan-uat.stage.lz.seed.nsw.gov.au/robots.txt
Domain IPs 13.236.235.64, 13.236.75.149, 52.62.80.231
Response IP 13.236.235.64
Found Yes
Hash e5692a133e1e9afafb7ce555a0d4cb8807a4895537c21028661835e8b3c9bb77
SimHash 4d30cc20a202

Groups

*

Rule Path
Disallow /dataset/rate/
Disallow /revision/
Disallow /dataset/*/history
Disallow /api/

Other Records

Field Value
crawl-delay 10