cafelor.com.br
robots.txt

Robots Exclusion Standard data for cafelor.com.br

Resource Scan

Scan Details

Site Domain cafelor.com.br
Base Domain cafelor.com.br
Scan Status Ok
Last Scan2024-05-03T00:50:03+00:00
Next Scan 2024-06-02T00:50:03+00:00

Last Scan

Scanned2024-05-03T00:50:03+00:00
URL https://www.cafelor.com.br/robots.txt
Domain IPs 108.157.254.34, 108.157.254.56, 108.157.254.83, 108.157.254.85, 2600:9000:2753:4400:4:e87a:8c00:93a1, 2600:9000:2753:5400:4:e87a:8c00:93a1, 2600:9000:2753:6200:4:e87a:8c00:93a1, 2600:9000:2753:cc00:4:e87a:8c00:93a1, 2600:9000:2753:da00:4:e87a:8c00:93a1, 2600:9000:2753:de00:4:e87a:8c00:93a1, 2600:9000:2753:e000:4:e87a:8c00:93a1, 2600:9000:2753:f000:4:e87a:8c00:93a1
Response IP 108.157.254.34
Found Yes
Hash 7e6858459232c79191768294bae7573c9a721f42c6ecbcc4b4a378e6a69ea9b8
SimHash a4355d906f55

Groups

*

Rule Path
Disallow /account*
Disallow /login*
Disallow /checkout*
Disallow /busca*
Disallow /buscavazia*
Disallow /sistema/buscavazia*
Disallow /quick-view*
Disallow /espiar*
Disallow /*?map=*
Disallow /*map%3D*
Disallow /Sistema*
Disallow /sistema*
Disallow /seller-info*
Disallow /*%C3%82%C2%BF
Disallow /*%C3%82%C2%BD
Disallow /*%20
Disallow /compre-seu-cafe/lor/*

Other Records

Field Value
sitemap https://www.cafelor.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.