pipelinevalor.globo.com
robots.txt

Robots Exclusion Standard data for pipelinevalor.globo.com

Resource Scan

Scan Details

Site Domain pipelinevalor.globo.com
Base Domain globo.com
Scan Status Ok
Last Scan2024-06-25T00:29:13+00:00
Next Scan 2024-07-25T00:29:13+00:00

Last Scan

Scanned2024-06-25T00:29:13+00:00
URL https://pipelinevalor.globo.com/robots.txt
Domain IPs 201.7.177.220
Response IP 201.7.177.220
Found Yes
Hash 377a6d0bfb0fe2e2bf3921d70de4be529769b5af9517986cb83d14f1955e04db
SimHash 20259840e1d1

Groups

*

Rule Path
Disallow /busca/
Disallow /beta/

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pipelinevalor.globo.com/sitemap/pipelinevalor/sitemap.xml
sitemap https://pipelinevalor.globo.com/sitemap/pipelinevalor/news.xml