cosmos.com.mx
robots.txt
Robots Exclusion Standard data for cosmos.com.mx
Resource Scan
Scan Details
| Site Domain | cosmos.com.mx |
| Base Domain | cosmos.com.mx |
| Scan Status | Ok |
| Last Scan | 2024-09-28T11:04:23+00:00 |
| Next Scan | 2024-10-28T11:04:23+00:00 |
Last Scan
| Scanned | 2024-09-28T11:04:23+00:00 |
| URL | https://cosmos.com.mx/robots.txt |
| Redirect | https://www.cosmos.com.mx/robots.txt |
| Redirect Domain | www.cosmos.com.mx |
| Redirect Base | cosmos.com.mx |
| Domain IPs | 104.26.14.201, 104.26.15.201, 172.67.74.66, 2606:4700:20::681a:ec9, 2606:4700:20::681a:fc9, 2606:4700:20::ac43:4a42 |
| Redirect IPs | 104.26.14.201, 104.26.15.201, 172.67.74.66, 2606:4700:20::681a:ec9, 2606:4700:20::681a:fc9, 2606:4700:20::ac43:4a42 |
| Response IP | 172.67.74.66 |
| Found | Yes |
| Hash | f542dabe38bcab9aa1a3138d80b3731bb01664b2432de0bedaa170897a21b89c |
| SimHash | 8a3e8500e2b2 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cosmos.com.mx/sitemap.xml |
Warnings
- 4 invalid lines.