uol.com
robots.txt

Robots Exclusion Standard data for uol.com

Resource Scan

Scan Details

Site Domain uol.com
Base Domain uol.com
Scan Status Ok
Last Scan2024-11-09T03:47:51+00:00
Next Scan 2024-11-16T03:47:51+00:00

Last Scan

Scanned2024-11-09T03:47:51+00:00
URL https://uol.com/robots.txt
Redirect https://www.uol.com.br/robots.txt
Redirect Domain www.uol.com.br
Redirect Base uol.com.br
Domain IPs 3.165.102.101, 3.165.102.102, 3.165.102.19, 3.165.102.91
Redirect IPs 13.35.238.26, 13.35.238.43, 13.35.238.52, 13.35.238.76, 2600:9000:2085:1000:1:5a19:8b40:93a1, 2600:9000:2085:5c00:1:5a19:8b40:93a1, 2600:9000:2085:6a00:1:5a19:8b40:93a1, 2600:9000:2085:9a00:1:5a19:8b40:93a1, 2600:9000:2085:a800:1:5a19:8b40:93a1, 2600:9000:2085:d200:1:5a19:8b40:93a1, 2600:9000:2085:d400:1:5a19:8b40:93a1, 2600:9000:2085:f800:1:5a19:8b40:93a1
Response IP 13.35.238.76
Found Yes
Hash a655712ab0896dc61f1a9b46d0ba034c1446ce1999b07ad0a47130dc47d29f1e
SimHash ed05d841a773

Groups

*

Rule Path
Allow /
Disallow /carros/dev/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.uol.com.br/carros/sitemap/v2/news-01.xml
sitemap https://www.uol.com.br/ecoa/sitemap/news-01.xml
sitemap https://www.uol.com.br/esporte/sitemap/v2/news-01.xml
sitemap https://www.uol.com.br/nossa/sitemap/news-01.xml
sitemap https://www.uol.com.br/splash/sitemap/news-01.xml
sitemap https://www.uol.com.br/tilt/sitemap/news-01.xml
sitemap https://www.uol.com.br/universa/sitemap/v2/news-01.xml
sitemap https://www.uol.com.br/vivabem/sitemap/v2/news-01.xml
sitemap https://www.uol.com.br/apostas/api/?resource-id=sitemap&source=apostas/v1/articles.xml
sitemap https://www.uol.com.br/apostas/api/?resource-id=sitemap&source=apostas/v1/authors.xml
sitemap https://www.uol.com.br/apostas/api/?resource-id=sitemap&source=apostas/v1/content.xml
sitemap https://www.uol.com.br/apostas/api/?resource-id=sitemap&source=apostas/v1/news.xml

Comments

  • robots.txt