cargill.com.mx
robots.txt
Robots Exclusion Standard data for cargill.com.mx
Resource Scan
Scan Details
| Site Domain | cargill.com.mx |
| Base Domain | cargill.com.mx |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-19T22:43:36+00:00 |
| Next Scan | 2026-03-05T22:43:36+00:00 |
Last Successful Scan
| Scanned | 2026-01-12T22:27:13+00:00 |
| URL | https://www.cargill.com.mx/robots.txt |
| Domain IPs | 104.18.0.249, 104.18.1.249, 2606:4700::6812:1f9, 2606:4700::6812:f9 |
| Response IP | 104.18.0.249 |
| Found | Yes |
| Hash | 4051612a7f29e27eabcb3725fa98f47de8aa1b841f9f42e8f61aad0bbb8c69b2 |
| SimHash | c8109060c773 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /en/search-results |
| Disallow | /page/en/search-results |
| Disallow | /es/es-search-results |