Log In Sign Up

monza.corriere.it
robots.txt

Robots Exclusion Standard data for monza.corriere.it

Resource Scan

Scan Details

Site Domain monza.corriere.it
Base Domain corriere.it
Scan Status Ok
Last Scan2025-01-07T01:56:23+00:00
Next Scan 2025-01-14T01:56:23+00:00

Last Scan

Scanned2025-01-07T01:56:23+00:00
URL https://monza.corriere.it/robots.txt
Domain IPs 199.232.193.50, 199.232.197.50
Response IP 151.101.197.50
Found Yes
Hash 6c2a7144ba569532a489613b75f4ded6b66f3d75147c98d560df6c3a67995210
SimHash be8f41da0455

Groups

*

Rule Path
Disallow */localwebapp
Disallow /cronistipercaso/loadArg.do*
Disallow /ricerca/
Disallow /*_print.html$
Disallow /ultima_ora/
Disallow /notizie-ultima-ora/
Disallow /communityLocal/
Disallow /_template/
Disallow /apw.js
Disallow /*?app_v2

petalbot

Rule Path
Disallow /

yandex

Rule Path Comment
Disallow / prohibits crawling for the entire site

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.corriere.it/dynamic-sitemap/sitemap-last-100/Monza.xml
Back to top

Comments

  • ACAP version=1.0
Back to top

Warnings

  • 1 invalid line.
  • `acap-crawler` is not a known field.
  • `acap-disallow-crawl` is not a known field.
Back to top