ml-site.magazineluiza.com.br
robots.txt

Robots Exclusion Standard data for ml-site.magazineluiza.com.br

Resource Scan

Scan Details

Site Domain ml-site.magazineluiza.com.br
Base Domain magazineluiza.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-04T09:33:39+00:00
Next Scan 2024-08-02T09:33:39+00:00

Last Successful Scan

Scanned2023-01-03T05:10:32+00:00
URL https://ml-site.magazineluiza.com.br/robots.txt
Domain IPs 35.244.234.195
Response IP 35.244.234.195
Found Yes
Hash 5efbe793b7161f69839219d69cccf5c486f84fb99709ce4588df16e8e7421bb0
SimHash 084ccba486d0

Groups

alexabot

Rule Path
Allow /

*

Rule Path
Disallow /Includes/
Disallow /includes/
Disallow /crossdomain.xml
Disallow /estaticas/
Disallow /Estaticas/
Disallow /resenha/css/
Disallow /seguro/
Disallow /institucional/
Disallow /weba/
Disallow /quemsomos/xml/Topos.xml
Disallow /compra/
Disallow /nota-fiscal/
Disallow /boleto/

googlebot

Rule Path
Disallow /Includes/
Disallow /includes/
Disallow /crossdomain.xml
Disallow /estaticas/
Disallow /Estaticas/
Disallow /resenha/css/
Disallow /seguro/
Disallow /institucional/
Disallow /weba/
Disallow /quemsomos/xml/Topos.xml
Disallow /compra/
Disallow /nota-fiscal/
Disallow /boleto/
Disallow /*?sfilters=0
Disallow /busca/*/?*

adsbot-google

Rule Path
Disallow /Includes/
Disallow /includes/
Disallow /crossdomain.xml
Disallow /estaticas/
Disallow /Estaticas/
Disallow /resenha/css/
Disallow /seguro/
Disallow /institucional/
Disallow /weba/
Disallow /quemsomos/xml/Topos.xml
Disallow /compra/
Disallow /nota-fiscal/
Disallow /boleto/

mediapartners-google

Rule Path
Disallow /Includes/
Disallow /includes/
Disallow /crossdomain.xml
Disallow /estaticas/
Disallow /Estaticas/
Disallow /resenha/css/
Disallow /seguro/
Disallow /institucional/
Disallow /weba/
Disallow /quemsomos/xml/Topos.xml
Disallow /compra/
Disallow /nota-fiscal/
Disallow /boleto/

apis-google

Rule Path
Disallow /Includes/
Disallow /includes/
Disallow /crossdomain.xml
Disallow /estaticas/
Disallow /Estaticas/
Disallow /resenha/css/
Disallow /seguro/
Disallow /institucional/
Disallow /weba/
Disallow /quemsomos/xml/Topos.xml
Disallow /compra/
Disallow /nota-fiscal/
Disallow /boleto/