Log In Sign Up

magazzinitotopiccinni.it
robots.txt

Robots Exclusion Standard data for magazzinitotopiccinni.it

Resource Scan

Scan Details

Site Domain magazzinitotopiccinni.it
Base Domain magazzinitotopiccinni.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-26T03:43:24+00:00
Next Scan 2026-01-24T03:43:24+00:00

Last Successful Scan

Scanned2025-06-05T22:54:52+00:00
URL https://magazzinitotopiccinni.it/robots.txt
Domain IPs 85.25.208.214
Response IP 85.25.208.214
Found Yes
Hash 07f88cecdfb8ae3f95d3f68fd458b5310e895d71847ed71aa38fd76ab8600ddc
SimHash cd3cf9c5d3f3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /magento/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /var/
Disallow /quickview/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /*?srsltid
Disallow /*?dir=
Disallow /*price%3A-*
Disallow /*?price=*
Disallow /*?color=*
Disallow /*?size=*
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.php$
Disallow /*?p=*&
Disallow /*?SID=
Disallow /*?limit=all

seobility

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /
Disallow /checkout/

semrushbot/6~bl

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

zookabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

plesk screenshot bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.magazzinitotopiccinni.it/sitemap.xml
Back to top

Comments

  • Directories
  • Paths (clean URLs)
  • Blocca tutte le richieste che hanno “?srsltid=”
  • Blocca tutte le richieste che hanno “?dir=” (ordinamento asc/desc)
  • Blocca tutte le richieste che contengono “price:-” nella path
  • (Opzionale) Blocca altre query di filtro generiche
  • Files
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$
  • MASSIMILIANO DISABILITATI ALCUNI BOT
Back to top

Warnings

  • 2 invalid lines.
Back to top