Programmer Group

Spring Cloud Stream The underlying implementation of Srping cloud Bus is Spring Cloud Stream, which is designed to build a message-driven (or event-driven) micro-service architecture. Spring Cloud Stream itself encapsulates (integrates) and extends modules such as Spring Messaging, Spring Integration, Spring Boot Actuator, Spring Boot Externali ...

fault tolerance End-to-end assurance is one of the key goals of structured flow design. Structured Streaming sources,sinks, etc. are designed to track the exact processing progress and allow it to restart or rerun to handle any failures. streaming source is a kafka-like offsets to track the read location of the stream. The execution engine u ...

Article directory Preface pom Dependent Version Dome Preface There are some cases on the Internet about setting offset manually in kafka, but most of them use 0.8 version of kafka, which is written by scala. The version of kafka-0.10 is rarely mentioned or incomplete. Version 0.10 is compatible ...

Article directory Summary Birth background Business processes: Environmental Science Cui Hua! Upper code pom file Entrance last Summary Birth background A brief introduction to the background. At present, Kafka is the main message queue in our company. JQ uses both internal and external ne ...

This article mainly introduces the use and analysis of java multimedia file coding and processing tool class. The example code is very detailed in this paper. It has certain reference value for everyone's study or work. Friends who need it can refer to it. Introduce <dependency> <groupId>org.apache.storm</groupId> ...

I. Environmental Description1. Server information 172.21.184.43 kafka,zk 172.21.184.44 kafka,zk 172.21.184.45 kafka,zk 172.21.244.7 ansible 2. Software Version Information System: CentOS Linux release 7.5.1804 (Core) kafka: kafka_2.11-2.2.0 Zookeeper version: 3.4.8 ansible: ansible 2.7.10 II. Configuration preparation1. Write playbook-relate ...

I. Installation of Canal Docker Installation Stand-alone Canal Installation of RocketMQ Docker Installation Stand-alone RocketMQ 3. Configuring MQ of Canal Official documents 3.1 Modify the Canal Server configuration ################################################# ######### common argument ############# ################################## ...

Construction of Filebeat-> Logstash-> Kafka Data Acquisition Platform brief introduction demand programme Filebeat Logstash Unfinished Work brief introduction Because our company needs to collect data from various businesses, we need ...

Previous articles EFK Follow-up of Logging System: fluent-bit Service Independence It completes fluent-bit acquisition, fluentd forwarding to kafka, and then to elastic search. Later, it is mentioned that the server logs should be synchronized to the fluent-bit environment. This can be accomplished by incremental synchronization through rsync, ...

Spark Integrates Kafka's Two Patterns In development, we often use SparkStreaming to read and process data in kafka in real time. After version 1.3 of SparkStreaming, KafkaUtils provides two methods to create DStream: Receiver reception: KafkaUtils.c ...