Log In Sign Up

corrieredibologna.corriere.it
robots.txt

Robots Exclusion Standard data for corrieredibologna.corriere.it

Resource Scan

Scan Details

Site Domain corrieredibologna.corriere.it
Base Domain corriere.it
Scan Status Ok
Last Scan2024-05-09T19:07:08+00:00
Next Scan 2024-05-16T19:07:08+00:00

Last Scan

Scanned2024-05-09T19:07:08+00:00
URL https://corrieredibologna.corriere.it/robots.txt
Domain IPs 199.232.193.50, 199.232.197.50
Response IP 151.101.41.50
Found Yes
Hash 4c89823ce8a2a3c5d7b32be15acb6734dda314253d0ad0d14cc8e0ced01cb7a0
SimHash f25741f00c55

Groups

*

Rule Path
Disallow /privacy.shtml
Disallow /*_print.html$
Disallow /ultima_ora/
Disallow /notizie-ultima-ora/
Disallow /communityLocal/
Disallow /_template/
Disallow /*?app_v2
Disallow */localwebapp
Disallow /apw.js
Disallow /bologna/notizie/cronaca/2012/19-ottobre-2012/mori-casa-cura-procura-apre-fascicolo-2112329470966.shtml
Disallow /bologna/notizie/rossoblu/2013/1-marzo-2013/tomba-abbandonata-presidente-scudetto-2114268670687.shtml
Disallow /bologna/notizie/cronaca/2014/5-luglio-2014/simula-attentato-bordo-allarme-terrorismo-bologna-223517744160.shtml
Disallow /bologna/notizie/cronaca/2009/22-luglio-2009/traffico-dati-manette-14-persone-1601593770047.shtml
Disallow /bologna/notizie/cronaca/2013/7-febbraio-2013/mps-perquisizioni-finanza-galvani-fiduciaria-2113892869927.shtml
Disallow /bologna/notizie/cronaca/2013/5-aprile-2013/truffe-assicurazioni-117-processo--212505841612.shtml
Disallow /bologna/notizie/cronaca/2011/29-giugno-2011/sfilata-ex-rettori-tribunale-le-minacce-campos-190981214017.shtml
Disallow /bologna/notizie/cronaca/2011/12-ottobre-2011/bossoli-campos-chiesta-condanna-meduri-scorolli-1901803971452.shtml
Disallow /*/localwebapp/proRecensione.do*
Disallow /cronistipercaso/loadArg.do*
Disallow /ricerca/

petalbot

Rule Path
Disallow /

yandex

Rule Path Comment
Disallow / prohibits crawling for the entire site

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.corriere.it/dynamic-sitemap/sitemap-last-100/Bologna.xml
Back to top

Comments

  • ACAP version=1.0
Back to top

Warnings

  • `acap-crawler` is not a known field.
  • `acap-disallow-crawl` is not a known field.
Back to top