A tool for a long time in silence: supervisor
Note that since the supervisor cannot monitor the background program, all commands executed by the command need to be executed in the foreground, such as nginx: command = /usr/local/bin/nginx -g 'daemon off;'
Talk about the benefits of this tool:Manage your process, terminate the automatic restart service process abnormallyTurn off the machine ...
Posted by nwoottonn on Fri, 29 Nov 2019 10:20:32 -0800
Hadoop HA double namenode construction
Machine distribution
hadoop1 192.168.56121
hadoop2 192.168.56122
hadoop3 192.168.56123
Preparing the installation package
jdk-7u71-linux-x64.tar.gz
zookeeper-3.4.9.tar.gz
hadoop-2.9.2.tar.gz
Upload the installation package to the / usr/local directory of three machines and extract it
Configure hosts
echo "192.168.56.121 hadoop1" >> /etc/ ...
Posted by bungychicago on Fri, 29 Nov 2019 09:16:17 -0800
kafka, it's not hard
1. Introduction to Kafka
1.1. Main functions
According to the introduction of the official website, ApacheKafka ® is a distributed streaming media platform, which has three main functions:
1: It lets you publish and subscribe to streams of records
2: it lets you store streams of records in a fault tolerant way
3: It lets you process ...
Posted by RobbertvanOs on Fri, 29 Nov 2019 00:58:59 -0800
Big data environment building series - zookeeper cluster building
Summary
This blog builds a cluster environment based on zookeeper-3.4.9.
1. Download zookeeper
Edition: http://zookeeper.apache.org/releases.html#download
Download version: zookeeper-3.4.9.tar.gz
2. Host
192.168.8.21, 192.168.8.22, 192.168.8.23, 192.168.8.24 and 192.168.8.25.
3. Decompression
tar -zxvf zookeeper-3.4.9.t ...
Posted by andreea115 on Tue, 26 Nov 2019 07:28:59 -0800
Dubbo springboot entry level demo
1. Dubbo springboot entry level demo
1.1. Preface
The last operation and maintenance friend mentioned to me that their company wanted to do a dubbo gray publishing function, and this function fell to him. In my impression, dubbo should be able to realize specific users' routing to specific servers through extended code, so as to realize the gr ...
Posted by keziah on Mon, 25 Nov 2019 14:21:33 -0800
Dubbo source code analysis practice - the mystery of routing Router
The second keyword in cluster fault tolerance is Router, which means routing in Chinese
The front-end routing is different from the back-end routing, but the idea is basically the same
In view of the fact that many technical articles have a criticism, that is, they only talk about concepts, but not application scenarios. In fact, Router has i ...
Posted by noaksey2000 on Mon, 25 Nov 2019 09:51:42 -0800
logback.xml dynamic configurator path
Catalog
1. Ordinary java program
2.spring boot application
1. Ordinary java program
logback.xml configured as follows
<?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property name="LOGS_HOME" value="/opt/program/app/logback-demo/logs"/>
<!-- This value is passed in dynamically when th ...
Posted by coco777 on Wed, 20 Nov 2019 11:41:50 -0800
A task segmentation scheme based on zookeeper / cursor
If there is a table now, it records some delay messages, that is, messages that need to be sent out at a certain time in the future. The number of records in the table is uncertain. If there are many, then multiple machines are needed to execute. If there are few, then one or two will be enough. At this time, a leader election / task segmentati ...
Posted by FireyIce01 on Mon, 18 Nov 2019 09:53:51 -0800
HA high availability cluster construction
Common hadoop cluster
namenode(nn)
secondarynamenode(2nn)
datanode(dn)
The problems of common hadoop cluster
Is there a single point of failure with datanode?
No, because datanode has multiple machines and a copy mechanism as guarantee
Is there a single point of failure with the namenode?
Yes, because 2nn can't replac ...
Posted by zed420 on Wed, 13 Nov 2019 11:31:47 -0800
Zookeeper as configuration center usage instructions
To keep the data highly available, we use Zookeeper as the configuration center to save the data.SpringCloud also has an official description of Zookeeper integration: spring_cloud_zookeeper
Here is a practical explanation of how to use it.
1. Add Dependent Packages
<!-- Operations and Maintenance Monitoring -->
<dependency>
< ...
Posted by Rdam on Mon, 11 Nov 2019 18:43:35 -0800