espresso.repubblica.it
robots.txt
Robots Exclusion Standard data for espresso.repubblica.it
Resource Scan
Scan Details
Site Domain | espresso.repubblica.it |
Base Domain | repubblica.it |
Scan Status | Ok |
Last Scan | 2024-11-08T23:23:38+00:00 |
Next Scan | 2024-11-15T23:23:38+00:00 |
Last Scan
Scanned | 2024-11-08T23:23:38+00:00 |
URL | https://espresso.repubblica.it/robots.txt |
Domain IPs | 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50 |
Response IP | 3.165.82.42 |
Found | Yes |
Hash | 04f5a833dbc8615b7acf565f0bffc7256398ccd01da8abd8ee9cad33b153c581 |
SimHash | 214040606125 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /plus/articoli/2020/08/14/news/lavvocato-luca-zaia-soldi-malta-1.352135 |
Disallow | /plus/articoli/2020/07/02/news/perche-ucciso-diabolik-fabrizio-piscitelli-diabolik-1.350446 |
Disallow | /palazzo/2009/12/11/news/l-autunno-del-grande-seduttore1.22598/ |
Disallow | /palazzo/2009/02/26/news/cosi-hanno-salvato-il-cavaliere1.12362/ |
Disallow | /inchieste/2020/08/13/news/la-sede-dell-avvocato-di-zaia-nel-grattacielo-del-mandante-dell-omicidio-di-daphne-1.352162/ |
Disallow | /food/autore/di%2BAngie%2BSegovia |
Disallow | /food/?ref= |
Disallow | /food/?p= |
Disallow | /attualita/2016/04/08/news/eldorado-las-vegas-1.258147 |