A brief introduction to the basic components of spring cloud

Introduction to spring cloud eureka As a registry, eureka plays an important role in microservices. At present, eureka and zookeeper are the mainstream registries. eureka is AP, zookeeper is CP. (CAP theory) Architecture diagram As can be seen from the architecture diagram, eureka adopts cs archite ...

Posted by shaitand on Wed, 12 Feb 2020 21:11:08 -0800

Flink notes: Flink uses EventTime to process real-time data

Combined with the previous post: Introduction to Time and Window in Flink , we learned that Flink's streaming process involves three time concepts. They are Event Time, induction time and Processing Time. If you still don't understand these three concepts of time, it's suggested that you jump to the pre ...

Posted by PHPSpirit on Wed, 12 Feb 2020 03:14:26 -0800

How to quickly build a Spark distributed architecture for big data

Build our Spark platform from scratch 1. Preparing the centeros environment In order to build a real cluster environment and achieve a highly available architecture, we should prepare at least three virtual machines as cluster nodes. So I bought three Alibaba cloud servers as our cluster nodes. ...

Posted by knelson on Tue, 04 Feb 2020 23:47:57 -0800

Installation of Dubbo admin management platform under centos7

1. Download Dubbo source code at https://github.com/alibaba/dubbo     2. Unzip the zip file to the directory "D: \ technical data \ zookeeper \ Dubbo master \ Dubbo master"   Manual packaging. Here you only need to package the war package of Dubbo admin. So go to the Dubbo admin directory and use maven to pac ...

Posted by tito on Fri, 31 Jan 2020 00:15:56 -0800

RequestProcessor for source code analysis of zookeeper

Catalog 1, RequestProcessor 2, PrepRequestProcessor 3, SyncRequestProcessor 4, FinalRequestProcessor 1, RequestProcessor The request processors are linked together to process transactions. Requests are always processed in order. Independent servers and master-slave servers link together slight ...

Posted by lucianbeauty on Mon, 13 Jan 2020 19:21:45 -0800

The construction of zookeeper single machine and cluster environment

1. Preface 19 years passed pretty fast. As the first one of 20 years, I want to make a simple summary here for the previous year: seriously, 19 years passed pretty miserable. Yes, the conclusion is this sentence. After all, the sense of ceremony must still exist. Well, let's not talk about it. I hope it's better after 20 years. Save more money ...

Posted by randydg on Tue, 07 Jan 2020 02:51:34 -0800

Build hadoop HA high availability

Step 1: Cluster Planning Step 2: set hosts Step3: turn off the firewall Step 4: turn off Selinux Step5: Keyless login Step 6: install jdk #decompression tar -xvf jdk-8u131-linux-x64.tar.gz mv jdk1.8.0_131 /usr/local/jdk1.8 #Setting environment variables vim /etc/profile JAVA_HOME=/usr/local/jdk1.8/ JAVA_BIN=/usr/local/ ...

Posted by scriptkiddie on Fri, 03 Jan 2020 09:30:56 -0800

Kubernetes+docker-DIY-kafka+zookeeper+manager cluster deployment

Foreword: Recent project of combining kafka and zookeeper containerization with rancher, I consulted related websites and books and found that there are many reasons why I chose to customize it if it is relatively strong to standardize the company. Let me briefly talk about the reasons why I chose to customize it finally: (Because k8s+kakfa te ...

Posted by harty83 on Fri, 20 Dec 2019 09:48:27 -0800

Talk about leader elector of storm nimbus

order This paper mainly studies the leader elector of storm nimbus Nimbus org/apache/storm/daemon/nimbus/Nimbus.java public static void main(String[] args) throws Exception { Utils.setupDefaultUncaughtExceptionHandler(); launch(new StandaloneINimbus()); } public static Nimbus launch(INimbus inimbus) throws Exception ...

Posted by Kelset on Tue, 17 Dec 2019 14:59:39 -0800

Kafka ou 2.12-2.0.0 installation process

1. Download Kafka? 2.12-2.0.0.tgz and upload it to / usr/local/kafka / Extract and remove the installation package 2. configuration Modify the config/server.properties of each server cd /usr/local/kafka/kafka_2.12-2.0.0/config vim server.properties Modify several places:broker.id : unique, fill in the number, 10,11,12,13,1 ...

Posted by N350CA on Sun, 15 Dec 2019 12:29:42 -0800