Kafka+Zookeeper cluster construction
Environmental preparation
Kafka
Version: kafka_2.10-0.10.2.0 (2.10 for Scala version 0.10.2.0 for Kafka version)
Official download address: http://kafka.apache.org/downloads
Zookeeper
Version: zookeeper-3.4.13
Official download address: http://zookeeper.apache.org/releases.html
JDK
Version: jdk1.8.0_
Official download address: h ...
Posted by NuLL[PL] on Tue, 10 Dec 2019 14:49:00 -0800
Kubernetes builds Zookeeper and Kafka clusters
Main references https://www.cnblogs.com/00986014w/p/9561901.html This blog post, but he's not using the official image of zookeeper
I use the Zookeeper cluster with three nodes, which can be modified by reference.
##Build Zookeeper cluster
zookeeper-svc.yaml of cluster Service
apiVersion: v1
kind: Service
metadata:
labels:
app: zookeeper ...
Posted by tunage on Tue, 10 Dec 2019 07:43:35 -0800
5. redis distributed lock
Reference link: https://www.cnblogs.com/linjiqin/p/8003838.html
1: Introduction
There are three ways to implement distributed lock: 1. Optimistic database lock; 2. redis based; 3. zookeeper based.
redis server is a single thread operation, which perfectly avoids the problem of multithreading synchronization and realizes atomicity.
First of all, ...
Posted by freshrod on Sat, 07 Dec 2019 12:19:12 -0800
zookeeper dynamically manages nginx configuration
Suppose we have a scenario in which all servers share the same configuration file, we can't maintain each server manually. At this time, we can use the configuration management function of zookeeper.
Environment: python + nginx + zookeeper
Objective: when the configuration file in zookeeper changes, nginx automatically pulls the latest config ...
Posted by tacojohn on Fri, 06 Dec 2019 18:35:38 -0800
Building the Mesos cluster environment of "advanced" docker (24)
>Original article, welcome to reprint. Reprint please indicate: reprint from IT people's story meeting Thank you!>Original link address: Building the Mesos cluster environment of "advanced" docker (24)
This time, I will start to operate. First, I will install the MES. How to install the MES. Source code: https://github.com/lim ...
Posted by jacksonmj on Wed, 04 Dec 2019 22:13:26 -0800
HBase installation configuration, using independent zookeeper
1.HBase installation configuration, using independent zookeeper
2. Modify environment variables:The first machine is planned to be master, the second machine is RegionServer, and then start RegionServer on the first machineMake a cluster1 master2 RegionServer
Execute vi /etc/profile on the machine, and add the following:export HBASE_HOME=/usr/ ...
Posted by vadercole on Tue, 03 Dec 2019 01:49:01 -0800
brew installation path under mac, with kafka as an example
Huge buildings are always made of one wood and one stone. Why don't we make them? I often do some odd things, that's why.
That's right, but I didn't say that! ——Lu Xun
brew is the installation package tool of mac system. Similar to yum or apt get.
What is the package path of brew installation. The following is an exam ...
Posted by geus on Sun, 01 Dec 2019 22:37:23 -0800
Zookeeper registry of dubbo
At present, dubbo supports a variety of registration centers: Zookeeper, Redis, Simple, Multicast, Etcd3.
This article analyzes how dubbo integrates Zookeeper to register and subscribe services when Zookeeper is used as the registration center.
First, Dubbo registers the service with Zookeeper, and the directory structure is as follows: (regist ...
Posted by Tensing on Sun, 01 Dec 2019 08:10:43 -0800
java Concurrent practice: connection pool implementation
Introduction to pool technology
In the process of using database, we often use database connection pool instead of directly using database connection to operate. This is because the cost of creating and destroying each database connection is expensive, and pooling technology creates resources in advance, which are reusable, so as to ensure that ...
Posted by acirilo on Sun, 01 Dec 2019 04:03:57 -0800
Implementation of distributed globally unique ID generator (supporting multiple registries)
In the business scenarios of order and payment, the generation rules and methods of DOC No. are very important. There are many kinds of implementation. The simplest one is based on mysql auto add primary key. The advantages and disadvantages of the scheme are not much discussed, and everyone knows. Today, we implement a distrib ...
Posted by lentin64 on Fri, 29 Nov 2019 12:02:28 -0800