Log In Sign Up

comune.imola.bo.it
robots.txt

Robots Exclusion Standard data for comune.imola.bo.it

Resource Scan

Scan Details

Site Domain comune.imola.bo.it
Base Domain imola.bo.it
Scan Status Ok
Last Scan2026-01-25T20:30:24+00:00
Next Scan 2026-02-08T20:30:24+00:00

Last Scan

Scanned2026-01-25T20:30:24+00:00
URL https://comune.imola.bo.it/robots.txt
Redirect https://www.comune.imola.bo.it/robots.txt
Redirect Domain www.comune.imola.bo.it
Redirect Base imola.bo.it
Domain IPs 15.161.77.42
Redirect IPs 15.161.77.42
Response IP 15.161.77.42
Found Yes
Hash dda2cdba1cd175150163d49b23d44f810b7fb358e574de703f9696fb12bfb074
SimHash 28828f544dc7

Groups

gigabot

Rule Path
Disallow /folder_contents$
Disallow /folder_factories$
Disallow /search
Disallow /sendto_form$
Disallow /api

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://www.comune.imola.bot.it/sitemap-index.xml
Back to top

Comments

  • robot exclusion for www.comune.imola.bo.it
  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
Back to top