cgr.go.cr
robots.txt
Robots Exclusion Standard data for cgr.go.cr
Resource Scan
Scan Details
| Site Domain | cgr.go.cr |
| Base Domain | cgr.go.cr |
| Scan Status | Ok |
| Last Scan | 2024-05-10T10:03:15+00:00 |
| Next Scan | 2024-06-09T10:03:15+00:00 |
Last Scan
| Scanned | 2024-05-10T10:03:15+00:00 |
| URL | https://www.cgr.go.cr/robots.txt |
| Domain IPs | 108.156.133.122, 108.156.133.66, 108.156.133.83, 108.156.133.85, 2600:9000:2755:200:1:221a:b000:93a1, 2600:9000:2755:2c00:1:221a:b000:93a1, 2600:9000:2755:3e00:1:221a:b000:93a1, 2600:9000:2755:4400:1:221a:b000:93a1, 2600:9000:2755:6800:1:221a:b000:93a1, 2600:9000:2755:8200:1:221a:b000:93a1, 2600:9000:2755:8400:1:221a:b000:93a1, 2600:9000:2755:e00:1:221a:b000:93a1 |
| Response IP | 108.156.133.83 |
| Found | Yes |
| Hash | 45682f0ff0f0733432439a38ac82771366a7947444fd857a5d404b2068087216 |
| SimHash | 3309477b59b4 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /10-varios/rss/* |
| Disallow | /08-recursos/* |
| Disallow | /10-varios/* |
| Disallow | /01-cgr-transp/transparencia-cgr-app.html |
| Disallow | /02-consultas/consulta-cp-app.html |
| Disallow | /02-consultas/consulta-djb-app.html |
| Disallow | /02-consultas/consulta-limites-ca-app.html |
| Disallow | /02-consultas/consulta-pp-app.html |
| Disallow | /02-consultas/consulta-zon-kilo-via-app.html |
| Disallow | /02-consultas/consulta-umbrales-cp-app.html |
| Disallow | /03-documentos/publicaciones/publicaciones-cgr-app.html |
| Disallow | /03-documentos/publicaciones/voces-transparentes/vt-app.html |
| Disallow | /04-servicios/suscripcion-listas-app.html |
| Disallow | /07-cgr-varios/cont-int-app.html |
| Disallow | /07-cgr-varios/avisos-app.html |
| Disallow | /08-recursos/menu-desplegable-2017.html |
| Disallow | /08-recursos/footer-17.html |
| Disallow | /08-recursos/header-17.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cgr.go.cr/sitemap.txt |