library.flinders.edu.au
robots.txt
Robots Exclusion Standard data for library.flinders.edu.au
Resource Scan
Scan Details
| Site Domain | library.flinders.edu.au |
| Base Domain | flinders.edu.au |
| Scan Status | Ok |
| Last Scan | 2024-06-29T05:22:24+00:00 |
| Next Scan | 2024-07-29T05:22:24+00:00 |
Last Scan
| Scanned | 2024-06-29T05:22:24+00:00 |
| URL | https://library.flinders.edu.au/robots.txt |
| Domain IPs | 13.35.18.104, 13.35.18.20, 13.35.18.23, 13.35.18.48, 2600:9000:20c7:3e00:19:e4b6:2600:93a1, 2600:9000:20c7:4400:19:e4b6:2600:93a1, 2600:9000:20c7:4c00:19:e4b6:2600:93a1, 2600:9000:20c7:5c00:19:e4b6:2600:93a1, 2600:9000:20c7:7200:19:e4b6:2600:93a1, 2600:9000:20c7:7c00:19:e4b6:2600:93a1, 2600:9000:20c7:9200:19:e4b6:2600:93a1, 2600:9000:20c7:ec00:19:e4b6:2600:93a1 |
| Response IP | 13.35.18.20 |
| Found | Yes |
| Hash | 8ed717868284609e78917c29180e9537d8c8b6c2f3575e4baf0a4eaf9a4e99b1 |
| SimHash | 6823dcb6c730 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 2 invalid lines.