espressonline.it
robots.txt
Robots Exclusion Standard data for espressonline.it
Resource Scan
Scan Details
Site Domain | espressonline.it |
Base Domain | espressonline.it |
Scan Status | Ok |
Last Scan | 2024-05-19T18:38:00+00:00 |
Next Scan | 2024-05-26T18:38:00+00:00 |
Last Scan
Scanned | 2024-05-19T18:38:00+00:00 |
URL | http://espressonline.it/robots.txt |
Redirect | http://espresso.repubblica.it/robots.txt |
Redirect Domain | espresso.repubblica.it |
Redirect Base | repubblica.it |
Domain IPs | 213.92.16.101 |
Redirect IPs | 13.33.30.108, 13.33.30.124, 13.33.30.33, 13.33.30.96 |
Response IP | 13.33.30.96 |
Found | Yes |
Hash | 613ac020fdc1efeaad6c991e87cb3ab1260bed1653286d3fcc14ee32aa1de755 |
SimHash | 214040606125 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /plus/articoli/2020/08/14/news/lavvocato-luca-zaia-soldi-malta-1.352135 |
Disallow | /plus/articoli/2020/07/02/news/perche-ucciso-diabolik-fabrizio-piscitelli-diabolik-1.350446 |
Disallow | /palazzo/2009/12/11/news/l-autunno-del-grande-seduttore1.22598/ |
Disallow | /palazzo/2009/02/26/news/cosi-hanno-salvato-il-cavaliere1.12362/ |
Disallow | /inchieste/2020/08/13/news/la-sede-dell-avvocato-di-zaia-nel-grattacielo-del-mandante-dell-omicidio-di-daphne-1.352162/ |
Disallow | /food/autore/di%2BAngie%2BSegovia |
Disallow | /food/?ref= |
Disallow | /food/?p= |
Disallow | /attualita/2016/04/08/news/eldorado-las-vegas-1.258147 |