investor.vanguard.com
robots.txt
Robots Exclusion Standard data for investor.vanguard.com
Resource Scan
Scan Details
Site Domain | investor.vanguard.com |
Base Domain | vanguard.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-13T07:33:01+00:00 |
Next Scan | 2024-08-12T07:33:01+00:00 |
Last Successful Scan
Scanned | 2024-03-23T07:31:31+00:00 |
URL | https://investor.vanguard.com/robots.txt |
Domain IPs | 23.32.29.9, 96.17.180.48 |
Response IP | 23.215.7.22 |
Found | Yes |
Hash | c4d078f1e5aca085b61bf14234c11143431b154b45c11a954fd2737d4d5f76b3 |
SimHash | 31012ec48898 |
Groups
*
Rule | Path |
---|---|
Disallow | /images/ |
Disallow | /homenews/ |
Disallow | /static/ |
Disallow | /about/pagenotfound |
Disallow | /about/pageunavailable |
Disallow | /at-cost/pagenotfound |
Disallow | /at-cost/pageunavailable |
Disallow | /savings/pagenotfound |
Disallow | /savings/pageunavailable |
Disallow | /my-portfolio/pagenotfound |
Disallow | /my-portfolio/pageunavailable |
Disallow | /corporate-portal/pagenotfound |
Disallow | /corporate-portal/pageunavailable |
Disallow | /home/pagenotfound |
Disallow | /home/pageunavailable |
Disallow | /what-we-offer/pagenotfound |
Disallow | /what-we-offer/pageunavailable |
Disallow | /contact-us/pagenotfound |
Disallow | /contact-us/pageunavailable |
Disallow | /404 |
Other Records
Field | Value |
---|---|
sitemap | https://investor.vanguard.com/sitemap-index.xml |