Kafka+Zookeeper cluster construction

Environmental preparation Kafka Version: kafka_2.10-0.10.2.0 (2.10 for Scala version 0.10.2.0 for Kafka version) Official download address: http://kafka.apache.org/downloads Zookeeper Version: zookeeper-3.4.13 Official download address: http://zookeeper.apache.org/releases.html JDK Version: jdk1.8.0_ Official download address: h ...

Posted by NuLL[PL] on Tue, 10 Dec 2019 14:49:00 -0800

Kubernetes builds Zookeeper and Kafka clusters

Main references https://www.cnblogs.com/00986014w/p/9561901.html This blog post, but he's not using the official image of zookeeper I use the Zookeeper cluster with three nodes, which can be modified by reference. ##Build Zookeeper cluster zookeeper-svc.yaml of cluster Service apiVersion: v1 kind: Service metadata: labels: app: zookeeper ...

Posted by tunage on Tue, 10 Dec 2019 07:43:35 -0800

5. redis distributed lock

Reference link: https://www.cnblogs.com/linjiqin/p/8003838.html 1: Introduction There are three ways to implement distributed lock: 1. Optimistic database lock; 2. redis based; 3. zookeeper based. redis server is a single thread operation, which perfectly avoids the problem of multithreading synchronization and realizes atomicity. First of all, ...

Posted by freshrod on Sat, 07 Dec 2019 12:19:12 -0800

zookeeper dynamically manages nginx configuration

Suppose we have a scenario in which all servers share the same configuration file, we can't maintain each server manually. At this time, we can use the configuration management function of zookeeper. Environment: python + nginx + zookeeper Objective: when the configuration file in zookeeper changes, nginx automatically pulls the latest config ...

Posted by tacojohn on Fri, 06 Dec 2019 18:35:38 -0800

Building the Mesos cluster environment of "advanced" docker (24)

>Original article, welcome to reprint. Reprint please indicate: reprint from IT people's story meeting Thank you!>Original link address: Building the Mesos cluster environment of "advanced" docker (24) This time, I will start to operate. First, I will install the MES. How to install the MES. Source code: https://github.com/lim ...

Posted by jacksonmj on Wed, 04 Dec 2019 22:13:26 -0800

HBase installation configuration, using independent zookeeper

1.HBase installation configuration, using independent zookeeper 2. Modify environment variables:The first machine is planned to be master, the second machine is RegionServer, and then start RegionServer on the first machineMake a cluster1 master2 RegionServer Execute vi /etc/profile on the machine, and add the following:export HBASE_HOME=/usr/ ...

Posted by vadercole on Tue, 03 Dec 2019 01:49:01 -0800

brew installation path under mac, with kafka as an example

Huge buildings are always made of one wood and one stone. Why don't we make them? I often do some odd things, that's why. That's right, but I didn't say that! ——Lu Xun brew is the installation package tool of mac system. Similar to yum or apt get. What is the package path of brew installation. The following is an exam ...

Posted by geus on Sun, 01 Dec 2019 22:37:23 -0800

Zookeeper registry of dubbo

At present, dubbo supports a variety of registration centers: Zookeeper, Redis, Simple, Multicast, Etcd3. This article analyzes how dubbo integrates Zookeeper to register and subscribe services when Zookeeper is used as the registration center. First, Dubbo registers the service with Zookeeper, and the directory structure is as follows: (regist ...

Posted by Tensing on Sun, 01 Dec 2019 08:10:43 -0800

java Concurrent practice: connection pool implementation

Introduction to pool technology In the process of using database, we often use database connection pool instead of directly using database connection to operate. This is because the cost of creating and destroying each database connection is expensive, and pooling technology creates resources in advance, which are reusable, so as to ensure that ...

Posted by acirilo on Sun, 01 Dec 2019 04:03:57 -0800

Implementation of distributed globally unique ID generator (supporting multiple registries)

In the business scenarios of order and payment, the generation rules and methods of DOC No. are very important. There are many kinds of implementation. The simplest one is based on mysql auto add primary key. The advantages and disadvantages of the scheme are not much discussed, and everyone knows. Today, we implement a distrib ...

Posted by lentin64 on Fri, 29 Nov 2019 12:02:28 -0800