ust.com
robots.txt
Robots Exclusion Standard data for ust.com
Resource Scan
Scan Details
| Site Domain | ust.com |
| Base Domain | ust.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-05T05:02:51+00:00 |
| Next Scan | 2026-03-05T05:02:51+00:00 |
Last Successful Scan
| Scanned | 2025-01-15T19:20:34+00:00 |
| URL | https://www.ust.com/robots.txt |
| Domain IPs | 162.159.140.142, 172.66.0.140, 2606:4700:7::8c, 2a06:98c1:58::8c |
| Response IP | 172.66.0.140 |
| Found | Yes |
| Hash | 8541395069c6225c746e4cfc0788d8ef5b2104d5e2747099094347e63d29fa73 |
| SimHash | 7d054f50c5b7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*? |
| Disallow | /private |
| Disallow | /content/dam/ust/documents/spain/ |
| Disallow | /es/legal-notice/calidad/einf |
| Disallow | /en/errors/ |
| Disallow | /en/cyberproof |
| Disallow | /cyberproof-microsoft-security-sellers |
| Disallow | /en/insights/cybersecurity-soc-noc-insurance |
| Disallow | /en/insights/cybersecurity-xdr-banking |
| Disallow | /en/insights/cloud-cybersecurity-industrial-supplies |
| Disallow | /en/insights/cybersecurity-mdr-travel-software |
| Disallow | /en/forrester-report |
| Disallow | /en/insights/targeted-threat-intelligence-turning-challenges-into-opportunities |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ust.com/sitemap.xml |
| sitemap | https://www.ust.com/es/sitemap.xml |
| sitemap | https://www.ust.com/au/sitemap.xml |
| sitemap | https://www.ust.com/en/insights/sitemap.xml |
Comments