carros.uol.com.br
robots.txt

Robots Exclusion Standard data for carros.uol.com.br

Resource Scan

Scan Details

Site Domain carros.uol.com.br
Base Domain uol.com.br
Scan Status Ok
Last Scan2024-04-25T07:42:57+00:00
Next Scan 2024-05-25T07:42:57+00:00

Last Scan

Scanned2024-04-25T07:42:57+00:00
URL https://carros.uol.com.br/robots.txt
Redirect https://www.uol.com.br/carros/robots.txt
Redirect Domain www.uol.com.br
Redirect Base uol.com.br
Domain IPs 13.35.18.100, 13.35.18.18, 13.35.18.49, 13.35.18.58, 2600:9000:20c7:4000:b:3600:1940:93a1, 2600:9000:20c7:8600:b:3600:1940:93a1, 2600:9000:20c7:9400:b:3600:1940:93a1, 2600:9000:20c7:9600:b:3600:1940:93a1, 2600:9000:20c7:9800:b:3600:1940:93a1, 2600:9000:20c7:9c00:b:3600:1940:93a1, 2600:9000:20c7:d200:b:3600:1940:93a1, 2600:9000:20c7:f000:b:3600:1940:93a1
Redirect IPs 125.56.219.51, 2600:9000:229f:1800:1:5a19:8b40:93a1, 2600:9000:229f:2a00:1:5a19:8b40:93a1, 2600:9000:229f:3600:1:5a19:8b40:93a1, 2600:9000:229f:4400:1:5a19:8b40:93a1, 2600:9000:229f:4800:1:5a19:8b40:93a1, 2600:9000:229f:6800:1:5a19:8b40:93a1, 2600:9000:229f:ca00:1:5a19:8b40:93a1, 2600:9000:229f:e400:1:5a19:8b40:93a1, 72.247.127.232
Response IP 13.33.30.29
Found Yes
Hash bb258962641d9847123e546f11effe1632da003c24d5b8c7a249a3534536189f
SimHash 6114d854e593

Groups

*

Rule Path
Disallow */dev/
Disallow /busca?q=
Disallow /*.jhtm
Disallow /next%3D

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://carros.uol.com.br/sitemap/index.xml