periodicoelmexicano.com.mx
robots.txt
Robots Exclusion Standard data for periodicoelmexicano.com.mx
Resource Scan
Scan Details
| Site Domain | periodicoelmexicano.com.mx |
| Base Domain | periodicoelmexicano.com.mx |
| Scan Status | Ok |
| Last Scan | 2025-05-09T23:02:53+00:00 |
| Next Scan | 2025-05-16T23:02:53+00:00 |
Last Scan
| Scanned | 2025-05-09T23:02:53+00:00 |
| URL | https://www.periodicoelmexicano.com.mx/robots.txt |
| Domain IPs | 13.226.2.103, 13.226.2.121, 13.226.2.54, 13.226.2.87, 2600:9000:25eb:200:18:c350:f1c0:93a1, 2600:9000:25eb:3600:18:c350:f1c0:93a1, 2600:9000:25eb:5800:18:c350:f1c0:93a1, 2600:9000:25eb:8600:18:c350:f1c0:93a1, 2600:9000:25eb:9000:18:c350:f1c0:93a1, 2600:9000:25eb:9a00:18:c350:f1c0:93a1, 2600:9000:25eb:aa00:18:c350:f1c0:93a1, 2600:9000:25eb:dc00:18:c350:f1c0:93a1 |
| Response IP | 18.165.122.18 |
| Found | Yes |
| Hash | 2734e8f88c7c228ecdde88f301dea48b77f7d87530c86b771fa7badf2f5a7fe7 |
| SimHash | 64335c254bb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*buscar/ |
| Disallow | /*.app.json |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.elsoldemexico.com.mx/sitemap/update.xml |