chevron.com
robots.txt
Robots Exclusion Standard data for chevron.com
Resource Scan
Scan Details
| Site Domain | chevron.com |
| Base Domain | chevron.com |
| Scan Status | Ok |
| Last Scan | 2024-09-17T07:11:48+00:00 |
| Next Scan | 2024-10-17T07:11:48+00:00 |
Last Scan
| Scanned | 2024-09-17T07:11:48+00:00 |
| URL | https://chevron.com/robots.txt |
| Redirect | https://www.chevron.com/robots.txt |
| Redirect Domain | www.chevron.com |
| Redirect Base | chevron.com |
| Domain IPs | 146.23.28.130 |
| Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | 2be94555d006f59617a5e02e1f87e4a3a0e2cc449197d9f748f7cc9da9ccd794 |
| SimHash | 9c0d1e1085c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /investment-in-america |
| Disallow | /Akamai |
| Disallow | /App_Browsers |
| Disallow | /App_Config |
| Disallow | /App_Data |
| Disallow | /Areas |
| Disallow | /bin |
| Disallow | /Content |
| Disallow | /Error |
| Disallow | /f5monitor |
| Disallow | /layouts |
| Disallow | /sitecore |
| Disallow | /sitecore_files |
| Disallow | /temp |
| Disallow | /upload |
| Disallow | /Views |
| Disallow | /xsl |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.chevron.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments