ciclodekrebs.com
robots.txt
Robots Exclusion Standard data for ciclodekrebs.com
Resource Scan
Scan Details
| Site Domain | ciclodekrebs.com |
| Base Domain | ciclodekrebs.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-11-22T08:49:17+00:00 |
| Next Scan | 2026-01-21T08:49:17+00:00 |
Last Successful Scan
| Scanned | 2025-09-24T04:32:56+00:00 |
| URL | https://ciclodekrebs.com/robots.txt |
| Redirect | https://www.ciclodekrebs.com/robots.txt |
| Redirect Domain | www.ciclodekrebs.com |
| Redirect Base | ciclodekrebs.com |
| Domain IPs | 104.21.62.168, 172.67.137.140, 2606:4700:3030::6815:3ea8, 2606:4700:3031::ac43:898c |
| Redirect IPs | 104.21.62.168, 172.67.137.140, 2606:4700:3030::6815:3ea8, 2606:4700:3031::ac43:898c |
| Response IP | 172.67.137.140 |
| Found | Yes |
| Hash | a440245dbd5a3eee671c0a063c4837aff5c44c5c3e4452fc8208f2542f058c3a |
| SimHash | 093d9a08cb93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /privacidad.html |
| Disallow | /aviso-legal.html |
| Disallow | /datos.jpg |
| Disallow | /busqueda.html |
| Disallow | /404.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ciclodekrebs.com/sitemap.php |