calis.delfi.lv
robots.txt
Robots Exclusion Standard data for calis.delfi.lv
Resource Scan
Scan Details
| Site Domain | calis.delfi.lv |
| Base Domain | delfi.lv |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-24T16:55:57+00:00 |
| Next Scan | 2024-11-23T16:55:57+00:00 |
Last Successful Scan
| Scanned | 2024-07-04T16:55:04+00:00 |
| URL | https://calis.delfi.lv/robots.txt |
| Domain IPs | 104.22.38.138, 104.22.39.138, 172.67.38.134 |
| Response IP | 172.67.38.134 |
| Found | Yes |
| Hash | e0ba861eb9c1f1eadbf9d4f16b6402104e028322a339801ace5dfe0547d0ff7d |
| SimHash | ef36061a6432 |
Warnings
- 28 invalid lines.
- `buser-agent` is not a known field.