A tool for a long time in silence: supervisor

Note that since the supervisor cannot monitor the background program, all commands executed by the command need to be executed in the foreground, such as nginx: command = /usr/local/bin/nginx -g 'daemon off;' Talk about the benefits of this tool:Manage your process, terminate the automatic restart service process abnormallyTurn off the machine ...

Posted by nwoottonn on Fri, 29 Nov 2019 10:20:32 -0800

Hadoop HA double namenode construction

Machine distribution hadoop1 192.168.56121 hadoop2 192.168.56122 hadoop3 192.168.56123 Preparing the installation package jdk-7u71-linux-x64.tar.gz zookeeper-3.4.9.tar.gz hadoop-2.9.2.tar.gz Upload the installation package to the / usr/local directory of three machines and extract it Configure hosts echo "192.168.56.121 hadoop1" >> /etc/ ...

Posted by bungychicago on Fri, 29 Nov 2019 09:16:17 -0800

kafka, it's not hard

1. Introduction to Kafka   1.1. Main functions According to the introduction of the official website, ApacheKafka ® is a distributed streaming media platform, which has three main functions: 1: It lets you publish and subscribe to streams of records 2: it lets you store streams of records in a fault tolerant way 3: It lets you process ...

Posted by RobbertvanOs on Fri, 29 Nov 2019 00:58:59 -0800

Big data environment building series - zookeeper cluster building

Summary This blog builds a cluster environment based on zookeeper-3.4.9. 1. Download zookeeper Edition: http://zookeeper.apache.org/releases.html#download Download version: zookeeper-3.4.9.tar.gz 2. Host 192.168.8.21, 192.168.8.22, 192.168.8.23, 192.168.8.24 and 192.168.8.25. 3. Decompression tar -zxvf zookeeper-3.4.9.t ...

Posted by andreea115 on Tue, 26 Nov 2019 07:28:59 -0800

Dubbo springboot entry level demo

1. Dubbo springboot entry level demo 1.1. Preface The last operation and maintenance friend mentioned to me that their company wanted to do a dubbo gray publishing function, and this function fell to him. In my impression, dubbo should be able to realize specific users' routing to specific servers through extended code, so as to realize the gr ...

Posted by keziah on Mon, 25 Nov 2019 14:21:33 -0800

Dubbo source code analysis practice - the mystery of routing Router

The second keyword in cluster fault tolerance is Router, which means routing in Chinese The front-end routing is different from the back-end routing, but the idea is basically the same In view of the fact that many technical articles have a criticism, that is, they only talk about concepts, but not application scenarios. In fact, Router has i ...

Posted by noaksey2000 on Mon, 25 Nov 2019 09:51:42 -0800

logback.xml dynamic configurator path

Catalog 1. Ordinary java program 2.spring boot application 1. Ordinary java program logback.xml configured as follows <?xml version="1.0" encoding="UTF-8"?> <configuration> <property name="LOGS_HOME" value="/opt/program/app/logback-demo/logs"/> <!-- This value is passed in dynamically when th ...

Posted by coco777 on Wed, 20 Nov 2019 11:41:50 -0800

A task segmentation scheme based on zookeeper / cursor

If there is a table now, it records some delay messages, that is, messages that need to be sent out at a certain time in the future. The number of records in the table is uncertain. If there are many, then multiple machines are needed to execute. If there are few, then one or two will be enough. At this time, a leader election / task segmentati ...

Posted by FireyIce01 on Mon, 18 Nov 2019 09:53:51 -0800

HA high availability cluster construction

Common hadoop cluster namenode(nn) secondarynamenode(2nn) datanode(dn) The problems of common hadoop cluster Is there a single point of failure with datanode? No, because datanode has multiple machines and a copy mechanism as guarantee Is there a single point of failure with the namenode? Yes, because 2nn can't replac ...

Posted by zed420 on Wed, 13 Nov 2019 11:31:47 -0800

Zookeeper as configuration center usage instructions

To keep the data highly available, we use Zookeeper as the configuration center to save the data.SpringCloud also has an official description of Zookeeper integration: spring_cloud_zookeeper Here is a practical explanation of how to use it. 1. Add Dependent Packages <!-- Operations and Maintenance Monitoring --> <dependency> &lt ...

Posted by Rdam on Mon, 11 Nov 2019 18:43:35 -0800