espresso.repubblica.it
robots.txt

Robots Exclusion Standard data for espresso.repubblica.it

Resource Scan

Scan Details

Site Domain espresso.repubblica.it
Base Domain repubblica.it
Scan Status Ok
Last Scan2024-11-08T23:23:38+00:00
Next Scan 2024-11-15T23:23:38+00:00

Last Scan

Scanned2024-11-08T23:23:38+00:00
URL https://espresso.repubblica.it/robots.txt
Domain IPs 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50
Response IP 3.165.82.42
Found Yes
Hash 04f5a833dbc8615b7acf565f0bffc7256398ccd01da8abd8ee9cad33b153c581
SimHash 214040606125

Groups

*

Rule Path
Allow /
Disallow /plus/articoli/2020/08/14/news/lavvocato-luca-zaia-soldi-malta-1.352135
Disallow /plus/articoli/2020/07/02/news/perche-ucciso-diabolik-fabrizio-piscitelli-diabolik-1.350446
Disallow /palazzo/2009/12/11/news/l-autunno-del-grande-seduttore1.22598/
Disallow /palazzo/2009/02/26/news/cosi-hanno-salvato-il-cavaliere1.12362/
Disallow /inchieste/2020/08/13/news/la-sede-dell-avvocato-di-zaia-nel-grattacielo-del-mandante-dell-omicidio-di-daphne-1.352162/
Disallow /food/autore/di%2BAngie%2BSegovia
Disallow /food/?ref=
Disallow /food/?p=
Disallow /attualita/2016/04/08/news/eldorado-las-vegas-1.258147

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /