sestini.com.br
robots.txt

Robots Exclusion Standard data for sestini.com.br

Resource Scan

Scan Details

Site Domain sestini.com.br
Base Domain sestini.com.br
Scan Status Ok
Last Scan2024-10-02T21:27:41+00:00
Next Scan 2024-10-16T21:27:41+00:00

Last Scan

Scanned2024-10-02T21:27:41+00:00
URL https://www.sestini.com.br/robots.txt
Domain IPs 18.155.68.3, 18.155.68.31, 18.155.68.81, 18.155.68.84, 2600:9000:23d2:3400:1:97ac:7b80:93a1, 2600:9000:23d2:4400:1:97ac:7b80:93a1, 2600:9000:23d2:4600:1:97ac:7b80:93a1, 2600:9000:23d2:5a00:1:97ac:7b80:93a1, 2600:9000:23d2:a00:1:97ac:7b80:93a1, 2600:9000:23d2:ae00:1:97ac:7b80:93a1, 2600:9000:23d2:e600:1:97ac:7b80:93a1, 2600:9000:23d2:f800:1:97ac:7b80:93a1
Response IP 18.155.68.81
Found Yes
Hash 36c0bdf181200310f2e94d11ce02d97507e3ad03a2594939df6560ecdcaa8a27
SimHash 6c11c703ad97

Groups

*

Rule Path
Disallow /*img
Disallow /account
Disallow /login
Disallow /checkout
Disallow /busca
Disallow /*quick-view
Disallow /*espiar
Disallow /*busca
Disallow /*specificationFilter
Disallow /*productCluster
Disallow /*?PS
Disallow /*%26PS
Disallow /*Dolar?map=c
Allow /*.css
Allow /*.js

Other Records

Field Value
sitemap https://www.sestini.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.