mathiasrodriguez.com
robots.txt
Robots Exclusion Standard data for mathiasrodriguez.com
Resource Scan
Scan Details
| Site Domain | mathiasrodriguez.com |
| Base Domain | mathiasrodriguez.com |
| Scan Status | Ok |
| Last Scan | 2025-11-08T23:49:17+00:00 |
| Next Scan | 2025-11-15T23:49:17+00:00 |
Last Scan
| Scanned | 2025-11-08T23:49:17+00:00 |
| URL | https://www.mathiasrodriguez.com/robots.txt |
| Domain IPs | 2404:6800:4003:c01::79, 74.125.130.121 |
| Response IP | 74.125.24.121 |
| Found | Yes |
| Hash | a4a64f8a59b881cc7a1e807644bcd0150cfe7d56aa91a9b4466b35fbc3645903 |
| SimHash | 1903d605c541 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /search/ | - |
| Disallow | /*/search/ | - |
| Disallow | /p/search.html | - |
| Disallow | /*archive | - |
| Disallow | /*?m=1 | - |
| Disallow | /*?widget=* | - |
| Disallow | /20*/ | ¡Cambio crucial aquí! |
| Allow | /20*/*.html | Nuevo: Permite posts con fechas |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mathiasrodriguez.com/sitemap.xml |