universal-credit.com
robots.txt
Robots Exclusion Standard data for universal-credit.com
Resource Scan
Scan Details
Site Domain | universal-credit.com |
Base Domain | universal-credit.com |
Scan Status | Ok |
Last Scan | 2024-09-22T17:19:50+00:00 |
Next Scan | 2024-10-06T17:19:50+00:00 |
Last Scan
Scanned | 2024-09-22T17:19:50+00:00 |
URL | https://universal-credit.com/robots.txt |
Redirect | https://www.universal-credit.com/robots.txt |
Redirect Domain | www.universal-credit.com |
Redirect Base | universal-credit.com |
Domain IPs | 100.20.103.35, 34.215.60.230, 34.217.173.205 |
Redirect IPs | 23.32.29.105, 23.32.29.90, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bdf |
Response IP | 23.32.29.105 |
Found | Yes |
Hash | 3519f5c957e5c0c7f34a8d6b8477b1d7bfda3d819c3454a90afda3ec75a5ddc6 |
SimHash | 41508c43c7b1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.universal-credit.com/sitemap-index.xml |
Warnings
- `host` is not a known field.