drogal.com.br
robots.txt

Robots Exclusion Standard data for drogal.com.br

Resource Scan

Scan Details

Site Domain drogal.com.br
Base Domain drogal.com.br
Scan Status Ok
Last Scan2024-09-17T05:31:04+00:00
Next Scan 2024-10-17T05:31:04+00:00

Last Scan

Scanned2024-09-17T05:31:04+00:00
URL https://www.drogal.com.br/robots.txt
Domain IPs 13.35.185.106, 13.35.185.12, 13.35.185.73, 13.35.185.95, 2600:9000:271a:4400:d:cef:9640:93a1, 2600:9000:271a:4c00:d:cef:9640:93a1, 2600:9000:271a:8000:d:cef:9640:93a1, 2600:9000:271a:8a00:d:cef:9640:93a1, 2600:9000:271a:b800:d:cef:9640:93a1, 2600:9000:271a:ce00:d:cef:9640:93a1, 2600:9000:271a:de00:d:cef:9640:93a1, 2600:9000:271a:f200:d:cef:9640:93a1
Response IP 3.165.82.90
Found Yes
Hash cd892384fa40b09937ddfa88f25911213333b9cea0cc247073b81d48e4aeb424
SimHash 6e102ba4eaf5

Groups

*

Rule Path
Disallow /*quick-view
Disallow /*control
Disallow /checkout
Disallow /*quick-view
Disallow /*Sistema
Disallow /account
Disallow /login
Disallow /*busca
Disallow /*specificationFilter
Disallow /espiar*
Disallow /buscapagina*
Disallow /*0800
Disallow /*adicionar-avaliacao
Disallow /*anvisa.gov.br
Disallow /*search
Disallow /*?p=
Disallow /admin/
Disallow /espiar/*
Disallow /*sort%3D
Disallow /no-cache
Allow /*.css
Allow /*.js

Other Records

Field Value
sitemap https://www.drogal.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.