universal-credit.com
robots.txt
Robots Exclusion Standard data for universal-credit.com
Resource Scan
Scan Details
Site Domain | universal-credit.com |
Base Domain | universal-credit.com |
Scan Status | Ok |
Last Scan | 2024-11-04T00:27:36+00:00 |
Next Scan | 2024-11-18T00:27:36+00:00 |
Last Scan
Scanned | 2024-11-04T00:27:36+00:00 |
URL | https://universal-credit.com/robots.txt |
Redirect | https://www.universal-credit.com/robots.txt |
Redirect Domain | www.universal-credit.com |
Redirect Base | universal-credit.com |
Domain IPs | 44.226.101.18, 44.241.45.219, 54.71.169.150 |
Redirect IPs | 23.59.168.97, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bdf |
Response IP | 23.59.168.97 |
Found | Yes |
Hash | 3519f5c957e5c0c7f34a8d6b8477b1d7bfda3d819c3454a90afda3ec75a5ddc6 |
SimHash | 41508c43c7b1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.universal-credit.com/sitemap-index.xml |
Warnings
- `host` is not a known field.