madrugaosuplementos.net.br
robots.txt

Robots Exclusion Standard data for madrugaosuplementos.net.br

Resource Scan

Scan Details

Site Domain madrugaosuplementos.net.br
Base Domain madrugaosuplementos.net.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-16T06:45:32+00:00
Next Scan 2025-02-14T06:45:32+00:00

Last Successful Scan

Scanned2024-07-10T04:12:23+00:00
URL https://www.madrugaosuplementos.net.br/robots.txt
Redirect https://www.madrugaosuplementos.com.br/robots.txt
Redirect Domain www.madrugaosuplementos.com.br
Redirect Base madrugaosuplementos.com.br
Domain IPs 104.21.13.136, 172.67.132.225, 2606:4700:3030::6815:d88, 2606:4700:3035::ac43:84e1
Redirect IPs 18.155.68.106, 18.155.68.58, 18.155.68.68, 18.155.68.82, 2600:9000:23d2:1200:6:7c67:8280:93a1, 2600:9000:23d2:2e00:6:7c67:8280:93a1, 2600:9000:23d2:3e00:6:7c67:8280:93a1, 2600:9000:23d2:4000:6:7c67:8280:93a1, 2600:9000:23d2:400:6:7c67:8280:93a1, 2600:9000:23d2:4600:6:7c67:8280:93a1, 2600:9000:23d2:8000:6:7c67:8280:93a1, 2600:9000:23d2:bc00:6:7c67:8280:93a1
Response IP 18.155.68.68
Found Yes
Hash 0321276be30b26906570849873e87fb0302b2752e43ef79b7d7823de2a2897a4
SimHash 6818ef674df5

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /logout/*
Disallow /checkout/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /esqueci-minha-senha/*
Disallow /meu-cadastro/*
Disallow /gerenciar-enderecos/*
Disallow /checkPassword/*
Disallow /nova-senha/*
Disallow /meus-pedidos/*
Disallow /busca/*
Disallow /admin/*
Allow /.js$
Allow /.css$
Allow /files

Other Records

Field Value
sitemap https://www.madrugaosuplementos.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.