ara.cat
robots.txt
Robots Exclusion Standard data for ara.cat
Resource Scan
Scan Details
| Site Domain | ara.cat |
| Base Domain | ara.cat |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-05T18:25:30+00:00 |
| Next Scan | 2025-01-03T18:25:30+00:00 |
Last Successful Scan
| Scanned | 2024-06-08T18:23:59+00:00 |
| URL | https://ara.cat/robots.txt |
| Redirect | https://www.ara.cat/robots.txt |
| Redirect Domain | www.ara.cat |
| Redirect Base | ara.cat |
| Domain IPs | 176.34.179.218 |
| Redirect IPs | 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4 |
| Response IP | 212.102.42.89 |
| Found | Yes |
| Hash | 4fcfa8460fa5db436723fa086ecb255d562ba432c992c1d8b9905c584fd0fe56 |
| SimHash | d08590ce0420 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bb3comment/ |
| Disallow | /21675759561/ |
| Disallow | /bbtmail/sendEntity/ |
| Disallow | /bbtshop/ |
| Disallow | /bbtstats/ |
| Disallow | /bbtcaptcha/ |
| Disallow | /bbtvaluation/vote/ |
| Disallow | /microsite/tests/ |
| Disallow | /microsite/test_rd/ |
| Disallow | /usuari/ |
| Disallow | /ediciodeldia/ |
| Disallow | /usuari/perfil/general.html |
| Disallow | /comment/report/ |
| Disallow | /cercador/ |
| Disallow | /aracomunitats/tag/list.html |
| Disallow | /dossier/Andrea-Chordi-necessiten-introspeccio-intelligencia_0_813518685.html |
| Disallow | /politica/Ara_Decidiu-Eleccions_25N-Andrea_Chordi-Mileurista_3_812348759.html |
| Disallow | /cronica/Tarrago-amenacen-guerra-control-Ficosa_0_593340690.html |
| Disallow | /cronica/Xavier-Pujol-Ficosa-imputat-falsificacio_0_601139920.html |
| Disallow | /b/ |
| Disallow | /educacio/LSTEI-Fiscalia-prevaricacio-JTS_0_1264673667.html |
| Disallow | /educacio/Bauza-suport-absolut-Nuria-Riera_0_1264673732.html |
| Disallow | /educacio/Riera-obligada-publiques-adjudicacions-interins_0_1271872984.html |
| Disallow | /educacio/Nuria-Riera-departament-Joan-Trobat_0_1264673792.html |
| Disallow | /educacio/Riera-desconvoca-reunio-comunitat-educativa_0_1264073811.html |
| Disallow | /politica/universidad-juan-carlos-investiga-casado-estudis_1_1222787.html |
| Disallow | /politica/lexpresident-sony-espanya-deslocalitzacio-viladecavalls_1_1888884.html |
| Disallow | /politica/pablo-ruz-jordi-pujol-ferrusola_1_2002839.html |
Comments