tgcom24.mediaset.it
robots.txt

Robots Exclusion Standard data for tgcom24.mediaset.it

Resource Scan

Scan Details

Site Domain tgcom24.mediaset.it
Base Domain mediaset.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-02-25T17:39:12+00:00
Next Scan 2024-05-25T17:39:12+00:00

Last Successful Scan

Scanned2023-10-06T16:46:45+00:00
URL https://tgcom24.mediaset.it/robots.txt
Redirect http://www.tgcom24.mediaset.it/robots.txt
Redirect Domain www.tgcom24.mediaset.it
Redirect Base mediaset.it
Domain IPs 91.211.156.137
Redirect IPs 2600:9000:25eb:3400:12:7c47:8d00:93a1, 2600:9000:25eb:3a00:12:7c47:8d00:93a1, 2600:9000:25eb:6000:12:7c47:8d00:93a1, 2600:9000:25eb:600:12:7c47:8d00:93a1, 2600:9000:25eb:6200:12:7c47:8d00:93a1, 2600:9000:25eb:9000:12:7c47:8d00:93a1, 2600:9000:25eb:9e00:12:7c47:8d00:93a1, 2600:9000:25eb:a800:12:7c47:8d00:93a1, 52.222.144.30, 52.222.144.57, 52.222.144.9, 52.222.144.96
Response IP 52.222.144.30
Found Yes
Hash f3b49b05110173e79f54db8155a086bff1895ddc599ad24f7d6341479cc96f92
SimHash 7558e0f89b38

Groups

*

Rule Path
Disallow /elezioni/withub/

Other Records

Field Value
sitemap https://www.tgcom24.mediaset.it/sitemap_news.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_sottosezioni.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_animali.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_cronaca.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_cultura.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_economia.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_green.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_magazine.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_mondo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_motori.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_politica.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_salute.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_skuola.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_spettacolo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_tgtech.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_televisione.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_viaggi.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_rubriche.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_speciale.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_donne.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_people.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_articoli_mastergame.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_dossier_tag_cronaca.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_dossier_tag_mondo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_animali.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_cronaca.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_cultura.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_economia.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_green.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_magazine.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_mondo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_motori.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_politica.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_salute.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_skuola.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_spettacolo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_tgtech.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_televisione.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_viaggi.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_rubriche.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_speciale.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_donne.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_people.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_fotogallery_mastergame.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_animali.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_cronaca.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_cultura.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_economia.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_green.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_magazine.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_mondo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_motori.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_politica.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_salute.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_skuola.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_spettacolo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_tgtech.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_televisione.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_viaggi.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_rubriche.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_speciale.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_donne.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_people.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_video_mastergame.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_cronaca.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_cultura.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_economia.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_green.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_mondo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_politica.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_rubriche.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_salute.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_skuola.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_spettacolo.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_sport.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_infografica_tgtech.xml
sitemap https://www.tgcom24.mediaset.it/ricette.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_news_list.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_elezioni_2023_comuni.xml
sitemap https://www.tgcom24.mediaset.it/sitemap_elezioni_2023_comunali.xml