amafarma.com
robots.txt

Robots Exclusion Standard data for amafarma.com

Resource Scan

Scan Details

Site Domain amafarma.com
Base Domain amafarma.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-30T20:58:24+00:00
Next Scan 2025-10-28T20:58:24+00:00

Last Successful Scan

Scanned2023-06-19T20:29:22+00:00
URL https://amafarma.com/robots.txt
Domain IPs 104.21.31.162, 172.67.178.70, 2606:4700:3030::ac43:b246, 2606:4700:3031::6815:1fa2
Response IP 104.21.31.162
Found Yes
Hash 278544384f855f4d53ffc62646628f05a8254d956e641836326d5aa010365ebf
SimHash a9b43832a6b0

Groups

*

Rule Path
Disallow /app/
Disallow /cgi-bin/
Disallow /dev/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /old/
Disallow *?dir=asc&order=*
Disallow *?dir=desc&order=*
Disallow *?new*
Disallow *?price*
Disallow *?order*
Disallow *?limit*
Disallow *?rating*
Disallow *?product_list_order=*
Disallow *?product_list_limit=*
Disallow *?q=*
Disallow *?product_list_mode=*
Disallow *?gender=*
Disallow /admin/
Disallow /catalog/*
Disallow /checkout/*
Disallow /customer/*
Disallow /feeds/*
Disallow /report/*
Disallow /review/*
Disallow /sales/*
Disallow /sendfriend/*
Disallow /tag/*
Disallow /wishlist/*
Disallow /catalogsearch/*
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /search/*
Disallow *?manufacturer=*
Disallow *?cat=*
Disallow /ricerca/*
Disallow *?brand=*
Disallow /productalert/*
Disallow /LICENSE*
Disallow /RELEASE_NOTES.txt
Disallow /install.php
Disallow /catalogsearch/result/*
Disallow /wishlist/*
Disallow /customer/*
Disallow /checkout/*
Disallow /*?dir*
Disallow /*?mode*
Disallow /*?SID=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/

Comments

  • Directory
  • Percorsi
  • File
  • MAGENTO SEO IMPROVEMENTS
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages