varesenews.it
robots.txt
Robots Exclusion Standard data for varesenews.it
Resource Scan
Scan Details
| Site Domain | varesenews.it |
| Base Domain | varesenews.it |
| Scan Status | Ok |
| Last Scan | 2024-09-18T18:24:44+00:00 |
| Next Scan | 2024-09-25T18:24:44+00:00 |
Last Scan
| Scanned | 2024-09-18T18:24:44+00:00 |
| URL | https://varesenews.it/robots.txt |
| Domain IPs | 81.21.26.116, 81.21.26.117 |
| Response IP | 81.21.26.117 |
| Found | Yes |
| Hash | f99aa81933fb55396bb1886f07a0e9d10fb764ca7cfb868f108bdd3aa275092b |
| SimHash | e3885c01c692 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /search |
| Disallow | *s%3D |
| Disallow | /*/feed/$ |
| Disallow | /2006/12/mafia-e-appalti-arresti-a-busto-e-gallarate/244627/ |
| Disallow | /2007/08/stroncato-traffico-internazionale-di-cocaina-quattro-arresti/231764/ |
| Disallow | /2007/10/carlo-ariosto-rimane-in-carcere/227626/ |
| Disallow | /2007/11/carlo-ariosto-esce-dal-carcere/227346/ |
| Disallow | /2008/04/ad-agrivarese-un-angolo-da-gustare-24-ore-su-24/218655/ |
| Disallow | /2008/05/mafia-e-finanza-arrestato-banchiere-di-lugano/216849/ |
| Disallow | /2008/06/42-chili-di-hascisc-dall-olanda-a-varese-tre-in-manette/213882/ |
| Disallow | /2011/05/rinviati-a-giudizio-i-furbetti-del-contatore/116730/ |
| Disallow | /2011/12/mafia-arrestato-imprenditore-a-gallarate/101052/ |
| Disallow | /2012/10/corruzione-e-turbativa-d-asta-arrestato-funzionario-comunale/78017/ |
| Disallow | /2013/10/sequestrati-anche-a-varese-i-beni-di-matteo-messina-denaro/50486/ |
| Disallow | /2014/11/da-varese-all-europa-e-ritorno/345591/ |
| Disallow | /2015/09/addio-bici-alla-schiranna/402692/ |
| Disallow | /2016/04/la-pizzeria-rubava-la-corrente-denunciato-il-titolare/506314/ |
| Disallow | /2016/10/fonsai-condanna-per-ligresti-una-speranza-per-i-risparmiatori/559122/ |
| Disallow | /2018/01/irene-stata-ritrovata-milano-sta-bene-ed-gia-suoi-genitori/684747/ |
| Disallow | /2018/01/irene-scomparsa-venerdi-suoi-genitori-chiedono-aiuto/683863/ |
| Disallow | /2018/01/proseguono-le-ricerche-irene-scomparsa-venerdi/684339/ |
| Disallow | /2011/06/smaltimento-di-rifiuti-pericolosi-arrestato-il-patron-del-riso-scotti/115645/ |
| Disallow | /2009/02/terremoto-ai-mastini-esonerato-malfatti/201197/ |
| Disallow | /2002/03/paolo-paoli-da-professore-di-liceo-a-presunto-falsario/289189/ |
| Disallow | /2004/05/sotto-inchiesta-gli-appalti-nella-sicurezza-otto-arresti/294604/ |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.varesenews.it/sitemap.xml |
Comments