ara.cat
robots.txt

Robots Exclusion Standard data for ara.cat

Resource Scan

Scan Details

Site Domain ara.cat
Base Domain ara.cat
Scan Status Ok
Last Scan2024-05-25T18:23:33+00:00
Next Scan 2024-06-01T18:23:33+00:00

Last Scan

Scanned2024-05-25T18:23:33+00:00
URL https://ara.cat/robots.txt
Redirect https://www.ara.cat/robots.txt
Redirect Domain www.ara.cat
Redirect Base ara.cat
Domain IPs 176.34.179.218
Redirect IPs 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4
Response IP 154.47.23.177
Found Yes
Hash 4fcfa8460fa5db436723fa086ecb255d562ba432c992c1d8b9905c584fd0fe56
SimHash d08590ce0420

Groups

*

Rule Path
Disallow /bb3comment/
Disallow /21675759561/
Disallow /bbtmail/sendEntity/
Disallow /bbtshop/
Disallow /bbtstats/
Disallow /bbtcaptcha/
Disallow /bbtvaluation/vote/
Disallow /microsite/tests/
Disallow /microsite/test_rd/
Disallow /usuari/
Disallow /ediciodeldia/
Disallow /usuari/perfil/general.html
Disallow /comment/report/
Disallow /cercador/
Disallow /aracomunitats/tag/list.html
Disallow /dossier/Andrea-Chordi-necessiten-introspeccio-intelligencia_0_813518685.html
Disallow /politica/Ara_Decidiu-Eleccions_25N-Andrea_Chordi-Mileurista_3_812348759.html
Disallow /cronica/Tarrago-amenacen-guerra-control-Ficosa_0_593340690.html
Disallow /cronica/Xavier-Pujol-Ficosa-imputat-falsificacio_0_601139920.html
Disallow /b/
Disallow /educacio/LSTEI-Fiscalia-prevaricacio-JTS_0_1264673667.html
Disallow /educacio/Bauza-suport-absolut-Nuria-Riera_0_1264673732.html
Disallow /educacio/Riera-obligada-publiques-adjudicacions-interins_0_1271872984.html
Disallow /educacio/Nuria-Riera-departament-Joan-Trobat_0_1264673792.html
Disallow /educacio/Riera-desconvoca-reunio-comunitat-educativa_0_1264073811.html
Disallow /politica/universidad-juan-carlos-investiga-casado-estudis_1_1222787.html
Disallow /politica/lexpresident-sony-espanya-deslocalitzacio-viladecavalls_1_1888884.html
Disallow /politica/pablo-ruz-jordi-pujol-ferrusola_1_2002839.html

Comments

  • Disallow: /bbtcomment/create/
  • Disallow: /bbtcomment/vote/
  • Disallow: /bbtcomment/report/
  • Disallow: /bbtcomment/entityComments/
  • Disallow: /webapi/