dizionari.corriere.it
robots.txt
Robots Exclusion Standard data for dizionari.corriere.it
Resource Scan
Scan Details
| Site Domain | dizionari.corriere.it |
| Base Domain | corriere.it |
| Scan Status | Ok |
| Last Scan | 2025-01-06T17:26:29+00:00 |
| Next Scan | 2025-01-13T17:26:29+00:00 |
Last Scan
| Scanned | 2025-01-06T17:26:29+00:00 |
| URL | https://dizionari.corriere.it/robots.txt |
| Domain IPs | 199.232.193.50, 199.232.197.50 |
| Response IP | 151.101.197.50 |
| Found | Yes |
| Hash | 5e713e914099ca06951fa425f20b6b42791d812456d8f3893da047ef42ffb113 |
| SimHash | 233fc840c2d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /dizionari_esplora/ |
| Disallow | /assets/ |
| Disallow | /includes/ |
| Disallow | /componenti/ |
| Disallow | /includes2013 |
| Disallow | /includes2007 |
| Disallow | /includes_methode |
| Disallow | /apw.js |
*
| Rule | Path |
|---|---|
| Disallow | /*app_v2 |
| Disallow | /*app_v1 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dizionari.corriere.it/sitemap_index.xml |
Warnings
- `request-rate` is not a known field.