Log In Sign Up

dengo.com.br
robots.txt

Robots Exclusion Standard data for dengo.com.br

Resource Scan

Scan Details

Site Domain dengo.com.br
Base Domain dengo.com.br
Scan Status Ok
Last Scan2024-09-17T05:25:46+00:00
Next Scan 2024-10-17T05:25:46+00:00

Last Scan

Scanned2024-09-17T05:25:46+00:00
URL https://www.dengo.com.br/robots.txt
Domain IPs 18.155.68.108, 18.155.68.127, 18.155.68.84, 18.155.68.86, 2600:9000:23d2:200:9:c0f1:7300:93a1, 2600:9000:23d2:7400:9:c0f1:7300:93a1, 2600:9000:23d2:7800:9:c0f1:7300:93a1, 2600:9000:23d2:9600:9:c0f1:7300:93a1, 2600:9000:23d2:ce00:9:c0f1:7300:93a1, 2600:9000:23d2:d800:9:c0f1:7300:93a1, 2600:9000:23d2:e200:9:c0f1:7300:93a1, 2600:9000:23d2:ea00:9:c0f1:7300:93a1
Response IP 18.155.68.108
Found Yes
Hash ebac5226347e8767eee84f3c0720b2c48d578e3d7fbeab787670346ec33e9bc0
SimHash e128ed074dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow */buscavazia?ft=*
Disallow */search$
Disallow */search?query=*&
Disallow *fq%3D*
Disallow *map%3D*
Back to top

Other Records

Field Value
sitemap https://www.dengo.com.br/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
Back to top

Warnings

  • `noindex` is not a known field.
Back to top