economia.uol.com.br
robots.txt

Robots Exclusion Standard data for economia.uol.com.br

Resource Scan

Scan Details

Site Domain economia.uol.com.br
Base Domain uol.com.br
Scan Status Ok
Last Scan2024-06-07T08:33:48+00:00
Next Scan 2024-06-21T08:33:48+00:00

Last Scan

Scanned2024-06-07T08:33:48+00:00
URL https://economia.uol.com.br/robots.txt
Domain IPs 2600:1413:a000::172c:5bb, 2600:1413:a000::172c:5d8, 72.247.127.249
Response IP 184.27.123.43
Found Yes
Hash c87efb5d82c13fcf320e9956a144932baef629047d78d9f124c0257b7bf22928
SimHash 251cd860e593

Groups

*

Rule Path
Disallow */dev/
Disallow /busca?q=
Disallow /*.jhtm
Disallow /next%3D

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://economia.uol.com.br/sitemap/v2/news-01.xml
sitemap https://economia.uol.com.br/sitemap/v2/index.xml
sitemap https://economia.uol.com.br/sitemap/index.xml