bol.uol.com.br
robots.txt

Robots Exclusion Standard data for bol.uol.com.br

Resource Scan

Scan Details

Site Domain bol.uol.com.br
Base Domain uol.com.br
Scan Status Ok
Last Scan2024-05-10T17:43:01+00:00
Next Scan 2024-06-09T17:43:01+00:00

Last Scan

Scanned2024-05-10T17:43:01+00:00
URL https://bol.uol.com.br/robots.txt
Redirect https://www.bol.uol.com.br/robots.txt
Redirect Domain www.bol.uol.com.br
Redirect Base uol.com.br
Domain IPs 200.147.4.73, 2804:49c:3101:405:ffff:ffff:ffff:22, 2804:49c:3102:405:ffff:ffff:ffff:6
Redirect IPs 23.52.171.129, 23.52.171.155, 2600:1413:b000:1e::17d1:2e57, 2600:1413:b000:1e::17d1:2e5b
Response IP 23.202.33.192
Found Yes
Hash 1816e530baf7dbd705f1714db95ee0954f6d73a56019352fb51e3d90276c2c99
SimHash e00598404d13

Groups

*

Rule Path
Disallow /dev/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bol.uol.com.br/sitemap/index.xml
sitemap https://www.bol.uol.com.br/sitemap/v2/news-index.xml