repubblica.it
robots.txt

Robots Exclusion Standard data for repubblica.it

Resource Scan

Scan Details

Site Domain repubblica.it
Base Domain repubblica.it
Scan Status Ok
Last Scan2024-05-04T20:23:43+00:00
Next Scan 2024-05-11T20:23:43+00:00

Last Scan

Scanned2024-05-04T20:23:43+00:00
URL https://repubblica.it/robots.txt
Redirect https://www.repubblica.it/robots.txt
Redirect Domain www.repubblica.it
Redirect Base repubblica.it
Domain IPs 13.226.2.14, 13.226.2.21, 13.226.2.3, 13.226.2.85
Redirect IPs 13.33.30.108, 13.33.30.124, 13.33.30.33, 13.33.30.96
Response IP 13.33.30.124
Found Yes
Hash 0716d658f0ef206aafc141b739d50c6099dec3ce505ca2b9e7bd67d301a98a2f
SimHash 10257f466638

Groups

*

Rule Path
Allow /
Disallow /viaggi/2014/07/02/foto/sudafrica_il_treno_vintage_diventa_hotel_con_vista-90509532/
Disallow /ultimora/24ore/nazionale/news-dettaglio/3688417
Disallow /ultimora/24ore/AUTO-IN-CAMBIO-DI-DROGA-13-ARRESTI-DELLA-POLIZIA-DI-PESCARA-%282%29/news-dettaglio/3746479
Disallow /ssnclude/canalrep/economia/rep_24ore_3685023.html
Disallow /sport/ciclismo/2023/10/24/news/doping_ciclismo_virtuale_azzurro_zanasca_rischia_una_lunga_squalifica-418660589/
Disallow /spettacoli/people/2023/09/07/news/kanye_west_e_bianca_censori_in_italia_la_lunga_estate_calda_degli_scandali-413629176/%26lt%3B
Disallow /spettacoli/people/2023/09/04/news/venezia_kanye_west_e_bianca_censori_banditi_per_atti_osceni_da_una_societa_di_noleggio_motoscafi-413301274/
Disallow /speciale/
Disallow /protagonisti/andrea_nucera/
Disallow /politica/2017/01/19/news/il_fratello_del_ministro_alfano_rischia_il_posto_e_costera_all_erario_mezzo_milione_di_euro%5B1%5D156371739/
Disallow /online/cronaca/veronaecstasy/bologna/bologna.html
Disallow /online/
Disallow /news/ired/ultimora/cronaca/rep_cronaca_n_3487677.html
Disallow /moda-e-beauty/2024/04/14/news/infedeli_storie_tradimento_franco-422464982/
Disallow /moda-e-beauty/2024/04/13/news/cabana_di_marina_mondadori_compie_dieci_anni-422471862/
Disallow /java
Disallow /ipad/
Disallow /interstitial/
Disallow /economia/miojob/rss
Disallow /economia/miojob/offerte/lavoro/cerca/*-*/*-*?*
Disallow /economia/miojob/offerte/lavoro/cerca/*-*/*-*/*
Disallow /economia/miojob/mobile/offerte/lavoro/cerca/*-*/*-*?*
Disallow /economia/miojob/mobile/offerte/lavoro/cerca/*-*/*-*/*
Disallow /economia/miojob/mobile/alert/crea/
Disallow /economia/finanza/2013/10/03/news/crac_cit_18_anni_per_gandolfi_in_tutto_nove_condannati-67830263/
Disallow /dal-quotidiano/
Disallow /cronaca/2023/09/29/news/serenis_repubblica_promozione_abbonati-416179220/
Disallow /cronaca/2019/12/05/news/stretta_contro_i_pirati_dei_giornali_rubati_800mila_lettori_in_un_anno_-301013213/
Disallow /corporate/privacy/index_static.html?
Disallow /cgi-bin/back.cgi
Disallow /blaize/datalayer
Disallow /2010/
Disallow /2009/
Disallow /2008/
Disallow /2007/
Disallow /2006/05/gallerie/politica/offese-da-premier-102/esterne130937331310093801_big.jpg
Disallow /2006/05/gallerie/politica/farabutti-foto-lettori-95/esterne191030071909103240_big.jpg
Disallow /2006/05/gallerie/politica/farabutti-foto-lettori-95/esterne191030071909103240.jpg
Disallow /2006/
Disallow /2005/
Disallow /2004/
Disallow /2003/
Disallow /swf
Disallow /serietv/schede/cerca/?query=
Disallow /online3
Disallow /mobile/
Disallow /ztest/
Disallow /topics/*?p=
Disallow /mobile-rep/
Disallow /tv/
Disallow /static/__sdemo__/
Disallow /quotidiano

googlebot-news

Rule Path
Disallow /la-zampa/

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.repubblica.it/sitemap-n.xml
sitemap https://video.repubblica.it/sitemap-v-day.xml
sitemap https://video.repubblica.it/sitemap-v.xml
sitemap https://www.repubblica.it/sitemap-moda-e-beauty-n.xml
sitemap https://www.repubblica.it/sitemap-italiantech-n.xml
sitemap https://www.repubblica.it/sitemap-il-gusto-n.xml
sitemap https://www.repubblica.it/sitemap-salute-n.xml
sitemap https://www.repubblica.it/sitemap-green-and-blue-n.xml
sitemap https://www.repubblica.it/sitemap-dirette-sport-n.xml
sitemap https://www.repubblica.it/sitemap.xml
sitemap https://www.repubblica.it/sitemap-moda-e-beauty.xml
sitemap https://www.repubblica.it/sitemap-italiantech.xml
sitemap https://www.repubblica.it/sitemap-il-gusto.xml
sitemap https://www.repubblica.it/sitemap-salute.xml
sitemap https://www.repubblica.it/sitemap-green-and-blue.xml
sitemap https://bari.repubblica.it/sitemap-n.xml
sitemap https://bologna.repubblica.it/sitemap-n.xml
sitemap https://firenze.repubblica.it/sitemap-n.xml
sitemap https://genova.repubblica.it/sitemap-n.xml
sitemap https://milano.repubblica.it/sitemap-n.xml
sitemap https://napoli.repubblica.it/sitemap-n.xml
sitemap https://palermo.repubblica.it/sitemap-n.xml
sitemap https://parma.repubblica.it/sitemap-n.xml
sitemap https://roma.repubblica.it/sitemap-n.xml
sitemap https://torino.repubblica.it/sitemap-n.xml
sitemap https://bari.repubblica.it/sitemap.xml
sitemap https://bologna.repubblica.it/sitemap.xml
sitemap https://firenze.repubblica.it/sitemap.xml
sitemap https://genova.repubblica.it/sitemap.xml
sitemap https://milano.repubblica.it/sitemap.xml
sitemap https://napoli.repubblica.it/sitemap.xml
sitemap https://palermo.repubblica.it/sitemap.xml
sitemap https://parma.repubblica.it/sitemap.xml
sitemap https://roma.repubblica.it/sitemap.xml
sitemap https://torino.repubblica.it/sitemap.xml

Warnings

  • 1 invalid line.