Installation and Use of Log Collection Framework Flume
Installation and Use of Log Collection Framework Flume
1. Introduction to Flume
1.1. Overview of Flume
Flume is a distributed, reliable and highly available system for collecting, transmitting and aggregating massive logs.
Flume can collect files, socket data packets and other forms of source data.
It can also output the collected d ...
Posted by MichaelR on Thu, 04 Apr 2019 20:12:30 -0700
Hadoop Double Name Node Configuration Build (HA)
The purpose of configuring dual namenode is to prevent errors and data loss from a namenode hanging up. The specific principle is not explained in detail in this paper, but the specific installation process is described here.
The construction of Hadoop HA is based on Zookeeper. You can see the construction of Zookeeper here. hadoop, zookeepe ...
Posted by anothersystem on Sat, 30 Mar 2019 08:21:30 -0700
Install hbase on ubuntu
hbase introduction
HBase is a distributed, column-oriented open source database. The technology originates from Fay Chang's Google paper Bigtable: A Distributed Storage System for Structured Data. Just as Bigtable takes advantage of the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities o ...
Posted by expert_21 on Fri, 29 Mar 2019 11:27:29 -0700
Integration and use of Dubbo with Zookeeper and Spring MVC (load balancing, fault tolerance)
With the development of Internet, the scale of website application is expanding, and the conventional vertical application architecture is unable to cope with it. Distributed service architecture and mobile computing architecture are imperative. Dubbo is a distributed service framework, which was born in this situation. Now the core business i ...
Posted by jamiefoxx on Mon, 25 Mar 2019 00:06:30 -0700
Practice of Real-time Operation and Maintenance Technology of Public Security Big Data Based on Spark
Source of the article: https://www.iteblog.com/archives/1956.html
There are tens of thousands of front-end and back-end equipments in the public security industry. Front-end equipments include cameras, detectors and sensors. Back-end equipments include servers, application servers, network equipments and power systems in central computer ...
Posted by Joseph07 on Sun, 24 Mar 2019 02:42:27 -0700
kafka Learning (1) Cluster Installation Configuration
Install java
Install zookeeper
1 Deployment Configuration
2 Configuration Notes
21 myid file and servermyid
22 zoocfg
23 log4jproperties
24 zkEnvsh and zkServersh files
3 parameter description
4 Start Test
Install KAFKA
1 Deployment Configuration
2 Start Server
3 Kafka test
3-day Note
supervisor management
1 Manage zookeeper
2. M ...
Posted by icesolid on Fri, 22 Mar 2019 09:27:52 -0700
[Mrpc] Demo2 Server Sensing and Load Balancing Based on Zookeeper
Because servers are often maintained, it is not good to write the address of the service implementation server directly in the client (including the configuration file). A better way is to register your address in the ZooKeeper cluster when the server starts up, and then the client can get a list of all servers when it starts up, and choose a ...
Posted by Zeceer on Thu, 21 Mar 2019 15:57:51 -0700
Construction of Kakfa Distributed Cluster
Based on the latest version of kafka_2.11-0.10.1.0, this paper describes the construction process of distributed Kafka cluster environment. Server List:
172.31.10.1
172.31.10.2
172.31.10.3
1. Download the kafka installation package
Log on to Kafka http://kafka.apache.org/.
Click the "Download" button on the left
Select the corres ...
Posted by jkkenzie on Wed, 20 Mar 2019 23:15:34 -0700
SUSE12Sp3 installation configuration. net core production environment - install zookeeper offline and install visualization tools
Use root account directly
1. zookeeper installation
Place the zookeeper-3.4.13.tar.gz installation package in the specified directory
sudo tar -zxvf zookeeper-3.4.13.tar.gz -C /usr
sudo mkdir /usr/zookeeper-3.4.13/data
sudo cp /usr/zookeeper-3.4.13/conf/zoo_sample.cfg /usr/zookeeper-3.4.13/conf/zoo.cfg
sudo vim /usr/zookeeper-3.4.13/conf/ ...
Posted by Wozzr on Sun, 03 Mar 2019 20:45:22 -0800
The project uses dubbo, zookeeper service report Can not initialize class org.I0Itec.zkclient.ZkClient
dubbo service is used in the project, zookeeper is used as the registry, logback is used as the log framework, and errors are reported as follows when starting the project:
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.I0Itec.zkclient.ZkClient
at com.alibaba.dubbo.remoting.zookeeper.zkclient.ZkclientZookeeperCl ...
Posted by mr.echo on Wed, 13 Feb 2019 18:42:19 -0800