Installation and Use of Log Collection Framework Flume

Installation and Use of Log Collection Framework Flume 1. Introduction to Flume 1.1. Overview of Flume Flume is a distributed, reliable and highly available system for collecting, transmitting and aggregating massive logs. Flume can collect files, socket data packets and other forms of source data. It can also output the collected d ...

Posted by MichaelR on Thu, 04 Apr 2019 20:12:30 -0700

Hadoop Double Name Node Configuration Build (HA)

The purpose of configuring dual namenode is to prevent errors and data loss from a namenode hanging up. The specific principle is not explained in detail in this paper, but the specific installation process is described here. The construction of Hadoop HA is based on Zookeeper. You can see the construction of Zookeeper here. hadoop, zookeepe ...

Posted by anothersystem on Sat, 30 Mar 2019 08:21:30 -0700

Install hbase on ubuntu

hbase introduction HBase is a distributed, column-oriented open source database. The technology originates from Fay Chang's Google paper Bigtable: A Distributed Storage System for Structured Data. Just as Bigtable takes advantage of the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities o ...

Posted by expert_21 on Fri, 29 Mar 2019 11:27:29 -0700

Integration and use of Dubbo with Zookeeper and Spring MVC (load balancing, fault tolerance)

With the development of Internet, the scale of website application is expanding, and the conventional vertical application architecture is unable to cope with it. Distributed service architecture and mobile computing architecture are imperative. Dubbo is a distributed service framework, which was born in this situation. Now the core business i ...

Posted by jamiefoxx on Mon, 25 Mar 2019 00:06:30 -0700

Practice of Real-time Operation and Maintenance Technology of Public Security Big Data Based on Spark

Source of the article: https://www.iteblog.com/archives/1956.html There are tens of thousands of front-end and back-end equipments in the public security industry. Front-end equipments include cameras, detectors and sensors. Back-end equipments include servers, application servers, network equipments and power systems in central computer ...

Posted by Joseph07 on Sun, 24 Mar 2019 02:42:27 -0700

kafka Learning (1) Cluster Installation Configuration

Install java Install zookeeper 1 Deployment Configuration 2 Configuration Notes 21 myid file and servermyid 22 zoocfg 23 log4jproperties 24 zkEnvsh and zkServersh files 3 parameter description 4 Start Test Install KAFKA 1 Deployment Configuration 2 Start Server 3 Kafka test 3-day Note supervisor management 1 Manage zookeeper 2. M ...

Posted by icesolid on Fri, 22 Mar 2019 09:27:52 -0700

[Mrpc] Demo2 Server Sensing and Load Balancing Based on Zookeeper

Because servers are often maintained, it is not good to write the address of the service implementation server directly in the client (including the configuration file). A better way is to register your address in the ZooKeeper cluster when the server starts up, and then the client can get a list of all servers when it starts up, and choose a ...

Posted by Zeceer on Thu, 21 Mar 2019 15:57:51 -0700

Construction of Kakfa Distributed Cluster

Based on the latest version of kafka_2.11-0.10.1.0, this paper describes the construction process of distributed Kafka cluster environment. Server List: 172.31.10.1 172.31.10.2 172.31.10.3 1. Download the kafka installation package Log on to Kafka http://kafka.apache.org/. Click the "Download" button on the left Select the corres ...

Posted by jkkenzie on Wed, 20 Mar 2019 23:15:34 -0700

SUSE12Sp3 installation configuration. net core production environment - install zookeeper offline and install visualization tools

Use root account directly 1. zookeeper installation Place the zookeeper-3.4.13.tar.gz installation package in the specified directory sudo tar -zxvf zookeeper-3.4.13.tar.gz -C /usr sudo mkdir /usr/zookeeper-3.4.13/data sudo cp /usr/zookeeper-3.4.13/conf/zoo_sample.cfg /usr/zookeeper-3.4.13/conf/zoo.cfg sudo vim /usr/zookeeper-3.4.13/conf/ ...

Posted by Wozzr on Sun, 03 Mar 2019 20:45:22 -0800

The project uses dubbo, zookeeper service report Can not initialize class org.I0Itec.zkclient.ZkClient

dubbo service is used in the project, zookeeper is used as the registry, logback is used as the log framework, and errors are reported as follows when starting the project: Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.I0Itec.zkclient.ZkClient at com.alibaba.dubbo.remoting.zookeeper.zkclient.ZkclientZookeeperCl ...

Posted by mr.echo on Wed, 13 Feb 2019 18:42:19 -0800