Programmer Group

Redis 5.0 was suddenly released by author Antirez, adding many new features. The biggest new feature of Redis 5.0 is the addition of a data structure Stream, which is a new powerful and persistent message queue supporting multi-cast. The author admits that Redis Stream has learned a lot from Kafka's design. The structure of Red ...

1. Mapper and Schema scheme: Transform the data format that kafka passes to spout. record->tuple mapper: Transform the data format from storm to kafka.tuple->record 2. Why customize the message format In many cases, the data passed from Kafka is not a simple string, it can be any object. The default new Fields("bytes") is not ap ...

This article mainly talks about the real experience in our work, how to build a 100 million-level log platform, and at the same time teaches you how to build such a 100 million-level ELK system.The specific development history of the log platform can be referred to the previous section "Evolution from ELK to EFK" S ...

Configtx.yaml is a Hyperledger Fabric block chain network operation and maintenance tool configtxgen used to generate channel creation blocks or channel transactions configuration files. The content of configtx.yaml directly determines the content of the generated generation blocks. This article will give a detailed Chinese description of confi ...

                     The source of this article is: http://blog.csdn.net/bluishglc/article/details/50945032 Reproduction in any form is strictly prohibited, otherwise CSDN will be entrusted to the official protection of rights and interests! Spark's official documentation repeatedly emphasizes operations that will work on RDD, w ...

First, what is MQ? What is the principle of MQ? MQ is the message queue, short for Message Queue. Message queuing is a way of communication. The essence of a message is a data structure. Because MQ centralizes the processing and storage of messages in the project, MQ has the functions of decoupling, concurrency and peak shaving. 1. ...

Looking at the Kafka document recently, I found that Kafka has one. Log Compaction Functions we haven't noticed before, but they have high potential practical value. What is Log Compaction Every piece of data in Kafka has a pair of Keys and Value s, which are stored on disk and will not be preserved permanently, but delete the earliest written ...

Source of the article: https://www.iteblog.com/archives/1956.html There are tens of thousands of front-end and back-end equipments in the public security industry. Front-end equipments include cameras, detectors and sensors. Back-end equipments include servers, application servers, network equipments and power systems in central computer ...

Install java Install zookeeper 1 Deployment Configuration 2 Configuration Notes 21 myid file and servermyid 22 zoocfg 23 log4jproperties 24 zkEnvsh and zkServersh files 3 parameter description 4 Start Test Install KAFKA 1 Deployment Configuration 2 Start Server 3 Kafka test 3-day Note supervisor management 1 Manage zookeeper 2. M ...

Based on the latest version of kafka_2.11-0.10.1.0, this paper describes the construction process of distributed Kafka cluster environment. Server List: 172.31.10.1 172.31.10.2 172.31.10.3 1. Download the kafka installation package Log on to Kafka http://kafka.apache.org/. Click the "Download" button on the left Select the corres ...