espressonline.it
robots.txt

Robots Exclusion Standard data for espressonline.it

Resource Scan

Scan Details

Site Domain espressonline.it
Base Domain espressonline.it
Scan Status Ok
Last Scan2024-05-19T18:38:00+00:00
Next Scan 2024-05-26T18:38:00+00:00

Last Scan

Scanned2024-05-19T18:38:00+00:00
URL http://espressonline.it/robots.txt
Redirect http://espresso.repubblica.it/robots.txt
Redirect Domain espresso.repubblica.it
Redirect Base repubblica.it
Domain IPs 213.92.16.101
Redirect IPs 13.33.30.108, 13.33.30.124, 13.33.30.33, 13.33.30.96
Response IP 13.33.30.96
Found Yes
Hash 613ac020fdc1efeaad6c991e87cb3ab1260bed1653286d3fcc14ee32aa1de755
SimHash 214040606125

Groups

*

Rule Path
Allow /
Disallow /plus/articoli/2020/08/14/news/lavvocato-luca-zaia-soldi-malta-1.352135
Disallow /plus/articoli/2020/07/02/news/perche-ucciso-diabolik-fabrizio-piscitelli-diabolik-1.350446
Disallow /palazzo/2009/12/11/news/l-autunno-del-grande-seduttore1.22598/
Disallow /palazzo/2009/02/26/news/cosi-hanno-salvato-il-cavaliere1.12362/
Disallow /inchieste/2020/08/13/news/la-sede-dell-avvocato-di-zaia-nel-grattacielo-del-mandante-dell-omicidio-di-daphne-1.352162/
Disallow /food/autore/di%2BAngie%2BSegovia
Disallow /food/?ref=
Disallow /food/?p=
Disallow /attualita/2016/04/08/news/eldorado-las-vegas-1.258147

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /