gopet.pe
robots.txt

Robots Exclusion Standard data for gopet.pe

Resource Scan

Scan Details

Site Domain gopet.pe
Base Domain gopet.pe
Scan Status Ok
Last Scan2025-03-16T09:08:57+00:00
Next Scan 2025-04-15T09:08:57+00:00

Last Scan

Scanned2025-03-16T09:08:57+00:00
URL https://gopet.pe/robots.txt
Redirect https://www.gopet.pe/robots.txt
Redirect Domain www.gopet.pe
Redirect Base gopet.pe
Domain IPs 162.55.84.37
Redirect IPs 13.33.45.25, 13.33.45.3, 13.33.45.51, 13.33.45.62, 2600:9000:229f:1800:f:59ab:77c0:93a1, 2600:9000:229f:1e00:f:59ab:77c0:93a1, 2600:9000:229f:2c00:f:59ab:77c0:93a1, 2600:9000:229f:2e00:f:59ab:77c0:93a1, 2600:9000:229f:6000:f:59ab:77c0:93a1, 2600:9000:229f:8600:f:59ab:77c0:93a1, 2600:9000:229f:ca00:f:59ab:77c0:93a1, 2600:9000:229f:ce00:f:59ab:77c0:93a1
Response IP 13.33.45.51
Found Yes
Hash 822043cce62012d6145030eb9e21f152198de9bc43405bee1f52627689d0a798
SimHash e418cd574dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.MiTienda.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.