When processing time series data, the data write cycle is usually related to the frequency of the data collection device, sometimes requiring the processing of a large number of data points every second. Prolonged processing of such large volumes of data can lead to storage issues. An effective solution is to use streaming to downsample …
CnosDB is a distributed time series database system, where the metadata cluster is one of the core components responsible for managing the metadata information of the entire cluster. Metadata includes database catalogs, DDL operations, tenant and user permissions, data sharding distribution, cluster node information, and more. The metadata cluster achieves high availability through the …
CnosDB Metadata Cluster: The Brain of a Distributed Time Series Database Read More »
CnosDB is a database focused on time series data processing. It has designed and implemented three powerful data repair functions specifically for the characteristics of time series data: timestamp_repair – Effectively repairs the timestamp column, supporting operations such as insertion, deletion, and no change. value_repair – Intelligently repairs the value column, optimizing based on timestamp …
Observability refers to gaining deep insights into a system’s operational state, performance, and root causes of issues by collecting and analyzing various metrics and log data, thereby enhancing system reliability and maintainability. In modern software development, good observability helps developers and operations teams better monitor system status, identify potential issues, and take timely action to …
AWS: Building a Large-Scale Observability Platform with CnosDB Read More »
In contemporary industrial automation systems, real-time monitoring and data analysis have become crucial. This article introduces how to achieve efficient data collection and storage from PLC devices in industrial control systems by integrating Apache PLC4X and CnosDB, providing engineers with more powerful data analysis and monitoring tools. Definition of PLC PLC stands for Programmable …
This article discusses the CnosDB system clock failure and proposes a solution to the system clock failure in a stand-alone environment and a cluster environment, which has very important guiding significance. Database fault tolerance: system clock failure Discussions arising from situations that may not exist One day, CnosDB intern Xiao Shao was designing time-sequential …
In this article, we will mainly introduce how to implement a Kafka+Telegraf+CnosDB synchronous real-time acquisition and storage solution of streaming data in the Ubuntu 22.04.2 LTS environment. In this operation, the CnosDB version is 2.3.0, the Kafka version is 2.5.1, and the Telegraf version is 1.27.1 Efficient data transmission: Easily connect Kafka real-time data to CnosDB …
Efficient Data Transmission: Easily Connect Kafka Real-time Data to CnosDB Read More »
In time-series databases, the operation of resources is a complex and crucial task. These operations often involve multiple steps, each of which may fail, leading to an inconsistent state of resources. For example, a user might want to delete a tenant in a CnosDB cluster, an operation that may require the deletion of various resources …
How Does CnosDB Ensure the Final Consistency of Multi-step Operations? Read More »
This article provides a brief introduction to the origin of time series compression tasks, classifies compression algorithms, and gives a brief overview of the advantages and disadvantages of common compression algorithms. Coding enthusiasts, come and explore the details! Introduction Time series data is a fundamental data type generated in various applications and fields such as …
The complexity of distributed storage systems involves issues such as data disaster recovery, consistency, high-concurrency requests, and large-capacity storage. This article combines the evolutionary history of CnosDB in a distributed environment, sharing insights on applying distributed theory to practical production, as well as the advantages, disadvantages, and application scenarios of different implementation methods. Distributed System …
Evolutionary Journey of Master-Replica in CnosDB Read More »
