Log In Sign Up

delfrio.com.br
robots.txt

Robots Exclusion Standard data for delfrio.com.br

Resource Scan

Scan Details

Site Domain delfrio.com.br
Base Domain delfrio.com.br
Scan Status Ok
Last Scan2026-03-02T17:29:56+00:00
Next Scan 2026-03-16T17:29:56+00:00

Last Scan

Scanned2026-03-02T17:29:56+00:00
URL https://delfrio.com.br/robots.txt
Redirect https://www.delfrio.com.br/robots.txt
Redirect Domain www.delfrio.com.br
Redirect Base delfrio.com.br
Domain IPs 104.21.59.243, 172.67.185.212, 2606:4700:3036::6815:3bf3, 2606:4700:3037::ac43:b9d4
Redirect IPs 104.21.59.243, 172.67.185.212, 2606:4700:3036::6815:3bf3, 2606:4700:3037::ac43:b9d4
Response IP 104.21.59.243
Found Yes
Hash ff33989377bbf1a908dde961837f18c0044cd6f96ca1b3d0a313c853ee73de87
SimHash 2f60717d07c2

Groups

*

Rule Path
Disallow /404/
Disallow /model/
Disallow /soap/
Disallow /view/
Disallow /config.php
Disallow /functions.php
Disallow /index.php/
Disallow /meus-pedidos/
Disallow /meu-cadastro/
Disallow /carrinho/
Disallow /checkout/
Disallow /meu-cadastro/
Disallow /cadastro/
Disallow /login/
Disallow /ajax/
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Back to top

Other Records

Field Value
sitemap https://www.delfrio.com.br/media/sitemap/sitemap.xml
Back to top

Comments

  • GENERAL SETTINGS
  • Enable robots.txt rules for all crawlers
  • Do not crawl common technical folders
  • Disallow: /media/
  • Do not crawl common files
  • MAGENTO SEO IMPROVEMENTS
  • Do not crawl 2-nd home page copy (example.com/index.php/). Uncomment it only if you activated Magento SEO URLs.
  • Do not crawl links with session IDs
  • Disallow: /*?pg=
  • Disallow: /*?termo=
  • Disallow: /*?marca=
  • Disallow: /*&marca=
  • Do not crawl checkout and user account pages
  • Do not crawl seach pages and not-SEO optimized catalog links
  • SERVER SETTINGS
  • Do not crawl common server technical folders and files
Back to top