Log In Sign Up

mash.com.br
robots.txt

Robots Exclusion Standard data for mash.com.br

Resource Scan

Scan Details

Site Domain mash.com.br
Base Domain mash.com.br
Scan Status Ok
Last Scan2024-09-17T04:34:10+00:00
Next Scan 2024-10-17T04:34:10+00:00

Last Scan

Scanned2024-09-17T04:34:10+00:00
URL https://mash.com.br/robots.txt
Redirect https://www.mash.com.br/robots.txt
Redirect Domain www.mash.com.br
Redirect Base mash.com.br
Domain IPs 149.56.2.250
Redirect IPs 13.35.18.17, 13.35.18.48, 13.35.18.70, 13.35.18.72, 2600:9000:20c7:1200:d:b490:b300:93a1, 2600:9000:20c7:1400:d:b490:b300:93a1, 2600:9000:20c7:1800:d:b490:b300:93a1, 2600:9000:20c7:2200:d:b490:b300:93a1, 2600:9000:20c7:5600:d:b490:b300:93a1, 2600:9000:20c7:9a00:d:b490:b300:93a1, 2600:9000:20c7:c400:d:b490:b300:93a1, 2600:9000:20c7:f600:d:b490:b300:93a1
Response IP 13.35.18.72
Found Yes
Hash f0c868f2f6812c9b55b71dc2cc24e366771b2a8e7e76709c31ae95fb3c1973c0
SimHash 16d0ac93fc94

Groups

*

Rule Path
Disallow /img/*
Disallow /Site/Carrinho.aspx
Disallow /Site/Servicos.aspx
Disallow /Site/TagsMaisPopulares.aspx
Disallow /Site/QuickView.aspx
Disallow /Site/Produto_Listas.aspx
Disallow /Site/ProdutoFrete.aspx
Disallow /Site/TagDetalhe.aspx
Disallow /busca*
Disallow /quick-view*
Disallow */opinions/*
Disallow *?PS*
Disallow *%26PS*
Disallow *?map*
Disallow *?initialMap*
Back to top

Other Records

Field Value
sitemap https://www.mash.com.br/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
Back to top

Warnings

  • 17 invalid lines.
Back to top