Dubbo admin officially supports 3.0 service governance
Introduction: Dubbo is no stranger to you. It is a microservice development framework, which provides two key capabilities: RPC communication and microservice governance. In daily development, we use more RPC communication capabilities provided by Dubbo, but less service governance capabilities. This paper will focus on service governance. Dubb ...
Posted by lepad on Mon, 06 Dec 2021 22:17:24 -0800
Fully distributed cluster
Fully distributed cluster in installation mode
1. Introduction to fully distributed mode
Fully distributed refers to using multiple machines to build a complete distributed file system in a real environment.
In the real world, hdfs Related daemons in are also distributed in different machines, such as:
-1. namenode As far as possible, the dae ...
Posted by Stryves on Mon, 06 Dec 2021 19:34:03 -0800
Principle of distributed algorithm
Common generation strategies of distributed ID
The common distributed ID generation strategies are as follows:
Database autoincrement ID.UUID generation.Redis's atomic self increasing mode.Split the database horizontally, and set the initial value and the same self increasing step size.Self increment ID for batch application.Snowflake algorit ...
Posted by formlesstree4 on Sun, 05 Dec 2021 21:39:01 -0800
ELK+Kafka build a distributed log collection system
catalogue
1, Disadvantages of traditional log collection
2, ELK collection system process
3, Build ELK system
4, Code
5, Verification effect
1, Disadvantages of traditional log collection
We know that most of us use logs to judge where the program reports errors, so that we can take a powerful medicine aga ...
Posted by vaanil on Sun, 05 Dec 2021 16:46:24 -0800
TIDB - synchronize logs to downstream Kafka using TiDB Binlog
1, TiDB Binlog
In the previous article, we introduced the use of TiDB Binlog to synchronize data to downstream Mysql. In this article, we learn to use TiDB Binlog tool to synchronize data to custom business logic in Kafka. For example, TIDB can synchronize data with ES, MongoDB or Redis. This function is not different from the binlog function ...
Posted by bigrollerdave on Sun, 05 Dec 2021 08:46:01 -0800
Multi machine and multi GPU distributed computing
Question: I have encountered a requirement before. Assuming that there are multiple computing nodes and multiple GPU s on multiple computing nodes need to be used to deal with the same huge task, how to build such a cluster in the python environment?
The first thought is to use MPI to carry out message transmission between parallel nodes, and ...
Posted by FamousMortimer on Sun, 05 Dec 2021 04:09:37 -0800
Apache Kafka foundation overview
What is kafka?
Apache Kafka is a distributed message queue based on publish / subscribe mode. It is an open source message system written by Scala. It is mainly used in the field of big data real-time processing and used to process streaming data. It is a very classic message engine and is famous for its high performance and high availability. ...
Posted by Rebel7284 on Fri, 03 Dec 2021 04:02:02 -0800
Is the snowflake algorithm really useful for System.currentTimeMillis() optimization?
As mentioned earlier, the snowflake algorithm uses System.currentTimeMillis() to obtain time. There is a saying that System.currentTimeMillis() is slow because each call will deal with the system. In the case of high concurrency, a large number of concurrent system calls are easy to affect the performance (calling it is even more time-consuming ...
Posted by JessePHP on Tue, 30 Nov 2021 08:51:27 -0800
String of Redis core data structure
From common String commands to actual application scenario requirements design and development, this chapter enables you who are unfamiliar with redis to quickly master and understand, and you who are familiar with redis to quickly consolidate relevant knowledge
1, Characteristic description
(1) String is the most basic type of Redis. A key c ...
Posted by chrisdee on Sun, 28 Nov 2021 09:25:55 -0800
Elasticsearch cross cluster search
1. Introduction
Elasticsearch introduces the Cross Cluster Search (CCS Cross Cluster Search) function in version 5.3 to replace the cube node to be discarded. Similar to triple node, Cross Cluster Search is used to realize cross cluster data search. Cross Cluster Search enables you to run a single search request against one or more remote clus ...
Posted by jhuedder on Fri, 26 Nov 2021 14:55:14 -0800