br.cointelegraph.com
robots.txt

Robots Exclusion Standard data for br.cointelegraph.com

Resource Scan

Scan Details

Site Domain br.cointelegraph.com
Base Domain cointelegraph.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-10T17:51:23+00:00
Next Scan 2024-07-09T17:51:23+00:00

Last Successful Scan

Scanned2023-11-20T15:42:01+00:00
URL https://br.cointelegraph.com/robots.txt
Domain IPs 104.19.210.104, 104.19.211.104
Response IP 104.19.210.104
Found Yes
Hash 6e6125cf6252bf1687369bbb8daf1059c2b51553ae33322e0b03576142411a5f
SimHash 040152c1e1d3

Groups

*

Rule Path
Disallow /marketcap
Disallow /embed/post-sidebar/
Disallow /embed/post-recomend/
Disallow /ripple-101
Disallow /category/quiz
Disallow /lightning-network-101
Disallow /search?query=*

Other Records

Field Value
sitemap https://br.cointelegraph.com/sitemap.xml