democrata.com.br
robots.txt

Robots Exclusion Standard data for democrata.com.br

Resource Scan

Scan Details

Site Domain democrata.com.br
Base Domain democrata.com.br
Scan Status Ok
Last Scan2024-04-13T09:41:48+00:00
Next Scan 2024-05-13T09:41:48+00:00

Last Scan

Scanned2024-04-13T09:41:48+00:00
URL https://www.democrata.com.br/robots.txt
Domain IPs 108.157.254.10, 108.157.254.104, 108.157.254.91, 108.157.254.92, 2600:9000:2753:2c00:2:f57b:5b00:93a1, 2600:9000:2753:4a00:2:f57b:5b00:93a1, 2600:9000:2753:5400:2:f57b:5b00:93a1, 2600:9000:2753:6e00:2:f57b:5b00:93a1, 2600:9000:2753:ae00:2:f57b:5b00:93a1, 2600:9000:2753:bc00:2:f57b:5b00:93a1, 2600:9000:2753:c000:2:f57b:5b00:93a1, 2600:9000:2753:d800:2:f57b:5b00:93a1
Response IP 108.157.254.91
Found Yes
Hash c9b08c226a4c2455152e960cbb7a1aa613424005e7a0f0a8dbb50cda770343e9
SimHash f010cd174dd0

Groups

*

Rule Path
Disallow /*?*priceFrom*
Disallow /*?*specificationFilter_26*
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /busca?*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /*productClusterSearchableIds*

Other Records

Field Value
sitemap https://www.democrata.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.