Log In Sign Up

informazione.it
robots.txt

Robots Exclusion Standard data for informazione.it

Resource Scan

Scan Details

Site Domain informazione.it
Base Domain informazione.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-02T02:42:50+00:00
Next Scan 2024-07-01T02:42:50+00:00

Last Successful Scan

Scanned2023-01-04T15:59:21+00:00
URL https://informazione.it/robots.txt
Redirect https://www.informazione.it/robots.txt
Redirect Domain www.informazione.it
Redirect Base informazione.it
Domain IPs 104.21.6.131, 172.67.154.220, 2606:4700:3031::6815:683, 2606:4700:3036::ac43:9adc
Redirect IPs 104.21.6.131, 172.67.154.220, 2606:4700:3031::6815:683, 2606:4700:3036::ac43:9adc
Response IP 104.21.6.131
Found Yes
Hash 259658bb39f222da1176091a01694e8025f7362b29752173ba69d578563c0d9d
SimHash 215de418e499

Groups

petalbot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 15

zoombot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 20

dotbot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 20

yandexbot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 20

livelapbot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /mailarticle.aspx
Disallow /janus.aspx
Disallow /view.aspx
Disallow /viewtop.aspx
Disallow /newssearchres.aspx
Disallow /newssearch
Disallow /newssection.aspx
Disallow /comments.aspx
Disallow /commenti
Disallow /tagcloud.aspx
Disallow /tagcloud
Disallow /timeline.aspx
Disallow /z/
Disallow /i/
Disallow /t/
Disallow /d/
Disallow /newarrive.aspx
Disallow /prinsert.aspx
Disallow /prlogin.aspx
Disallow /prinsertaf.aspx
Disallow /prregistration.aspx
Disallow /prboffice.aspx
Disallow /newsitem.aspx
Disallow /pressreleasepub.aspx
Disallow /sitemapindex000.xml
Disallow /sitemaps/n_sitemap.xml.gz
Disallow /newsitem/
Disallow /ScriptResource.axd
Disallow /prlist.aspx?whclau*
Disallow /comunicati-stampa/a/
Disallow /prsection.aspx
Disallow /prsearch.aspx
Disallow /comunicati-stampa/pnt/
Disallow /meteo/
Disallow /manageanniversaries/
Disallow /alertrequest/
Disallow /entity/artist/
Disallow /searchtwitter
Disallow /prtoplist.aspx
Disallow /ricerca-notizie
Disallow /e/
Disallow /dec
Disallow /aggiorna

semrushbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

grapeshotcrawler

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

admantx-eusyncbatch01

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

businesswirebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

yak

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

paperlibot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

proximic

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

megaindex.ru

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

twitterbot/1.0

Rule Path
Disallow

Other Records

Field Value
crawl-delay 7
Back to top

Other Records

Field Value
sitemap https://www.informazione.it/sitemapindex.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top