unique-dna.com
robots.txt
Robots Exclusion Standard data for unique-dna.com
Resource Scan
Scan Details
| Site Domain | unique-dna.com |
| Base Domain | unique-dna.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-21T16:24:42+00:00 |
| Next Scan | 2025-10-05T16:24:42+00:00 |
Last Successful Scan
| Scanned | 2025-08-14T16:04:43+00:00 |
| URL | https://unique-dna.com/robots.txt |
| Domain IPs | 2a02:4780:84:63ad:7c09:c8b0:d865:466a, 2a02:4780:84:be6:5d79:5c62:c6a8:ae96, 93.127.187.229, 93.127.196.168 |
| Response IP | 77.37.75.163 |
| Found | Yes |
| Hash | 14830ba546b7b624e4e16baba5cf4bd9f478f9f87a912105719775325f4e08b6 |
| SimHash | d90188026c9b |
Other Records
| Field | Value |
|---|---|
| sitemap | https://unique-dna.com/sitemap_index.xml |
Warnings
- 5 invalid lines.
- ` user-agent` is not a known field.
Comments