tr.cointelegraph.com
robots.txt

Robots Exclusion Standard data for tr.cointelegraph.com

Resource Scan

Scan Details

Site Domain tr.cointelegraph.com
Base Domain cointelegraph.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-11T07:30:45+00:00
Next Scan 2024-07-10T07:30:45+00:00

Last Successful Scan

Scanned2023-12-07T06:32:51+00:00
URL https://tr.cointelegraph.com/robots.txt
Domain IPs 104.19.210.104, 104.19.211.104
Response IP 104.19.211.104
Found Yes
Hash dce1cebdbe5ff55887c2ca425ab2e710dd31f268033729f9a3107fec11bbd845
SimHash 2b149260ead3

Groups

*

Rule Path
Allow /
Disallow /search?query=*
Disallow /search

Other Records

Field Value
sitemap https://tr.cointelegraph.com/sitemap.xml