mediagol.it
robots.txt
Robots Exclusion Standard data for mediagol.it
Resource Scan
Scan Details
| Site Domain | mediagol.it |
| Base Domain | mediagol.it |
| Scan Status | Ok |
| Last Scan | 2024-04-26T10:12:26+00:00 |
| Next Scan | 2024-05-03T10:12:26+00:00 |
Last Scan
| Scanned | 2024-04-26T10:12:26+00:00 |
| URL | https://www.mediagol.it/robots.txt |
| Domain IPs | 2600:9000:201f:1400:5:6d55:f200:93a1, 2600:9000:201f:5800:5:6d55:f200:93a1, 2600:9000:201f:6400:5:6d55:f200:93a1, 2600:9000:201f:6c00:5:6d55:f200:93a1, 2600:9000:201f:8000:5:6d55:f200:93a1, 2600:9000:201f:a00:5:6d55:f200:93a1, 2600:9000:201f:a400:5:6d55:f200:93a1, 2600:9000:201f:aa00:5:6d55:f200:93a1, 3.163.158.11, 3.163.158.3, 3.163.158.9, 3.163.158.99 |
| Response IP | 18.165.171.19 |
| Found | Yes |
| Hash | 7ecffbc8b8eb9ed39c4a541f048b7a20ba3570aa4b284fc58682805652aa06a8 |
| SimHash | 231f50a043f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */commenti/$ |
| Disallow | /rcs-community-comments-rest-api/ |
| Disallow | /archivio/pagina-*/pagina- |
| Disallow | /archivio/page/ |
| Disallow | /archivio/categoria/ |
| Disallow | /archivio/gallery/ |
| Disallow | /archivio/video/ |
| Disallow | /*commenti/ |
| Disallow | /*?app_v2 |
| Disallow | /*?app_v1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mediagol.it/sitemaps/sitemap.xml |
| sitemap | https://www.mediagol.it/sitemaps/sitemap-news.xml |