fotoenzo.it
robots.txt

Robots Exclusion Standard data for fotoenzo.it

Resource Scan

Scan Details

Site Domain fotoenzo.it
Base Domain fotoenzo.it
Scan Status Ok
Last Scan2026-01-30T01:33:12+00:00
Next Scan 2026-03-01T01:33:12+00:00

Last Scan

Scanned2026-01-30T01:33:12+00:00
URL https://fotoenzo.it/robots.txt
Redirect https://www.fotoenzo.it/robots.txt
Redirect Domain www.fotoenzo.it
Redirect Base fotoenzo.it
Domain IPs 2a00:6d40:4:1::c310:41, 89.46.110.41
Redirect IPs 2a00:6d40:4:1::c310:41, 89.46.110.41
Response IP 89.46.110.41
Found Yes
Hash d479a2b4159b2dd7c40296cba35715fde63ba22810a1a2303cc72e311da826ae
SimHash a91538748143

Groups

*

Rule Path
Disallow /*?
Disallow /*.json$
Disallow /wip/
Disallow /lang/
Disallow /necrologi-online/
Disallow /disabilita_messaggi_necrologie/

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

Other Records

Field Value
sitemap https://www.fotoenzo.it/sitemap.xml

Comments

  • Disable Chinese Baidu crawler
  • User-agent: Baiduspider
  • Disallow: /
  • Removing Documents From the Wayback Machine archive.org
  • Disable *.domaintools.com crawler
  • Crawler GoogleBot