chevrontexaco.com
robots.txt
Robots Exclusion Standard data for chevrontexaco.com
Resource Scan
Scan Details
| Site Domain | chevrontexaco.com |
| Base Domain | chevrontexaco.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-28T09:13:24+00:00 |
| Next Scan | 2025-11-04T09:13:24+00:00 |
Last Successful Scan
| Scanned | 2025-09-25T09:32:38+00:00 |
| URL | http://chevrontexaco.com/robots.txt |
| Redirect | https://www.chevron.com/robots.txt |
| Redirect Domain | www.chevron.com |
| Redirect Base | chevron.com |
| Domain IPs | 146.23.28.130 |
| Redirect IPs | 13.107.226.59, 13.107.253.59, 2620:1ec:29:1::59, 2620:1ec:48:1::59 |
| Response IP | 13.107.226.59 |
| Found | Yes |
| Hash | 2be94555d006f59617a5e02e1f87e4a3a0e2cc449197d9f748f7cc9da9ccd794 |
| SimHash | 9c0d1e1085c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /investment-in-america |
| Disallow | /Akamai |
| Disallow | /App_Browsers |
| Disallow | /App_Config |
| Disallow | /App_Data |
| Disallow | /Areas |
| Disallow | /bin |
| Disallow | /Content |
| Disallow | /Error |
| Disallow | /f5monitor |
| Disallow | /layouts |
| Disallow | /sitecore |
| Disallow | /sitecore_files |
| Disallow | /temp |
| Disallow | /upload |
| Disallow | /Views |
| Disallow | /xsl |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.chevron.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments