YDB is deployed in Mini Centos environment based on haoop, zookeeper and kafka

YDB is deployed in Mini Centos environment based on haoop, zookeeper and kafka YDB introduction YDB full name Yan Yun YDB It is a real-time, multi-dimensional, interactive query, statistics and analysis engine based on Hadoop distributed architecture. It has second-level performance under trillion data scale and stable and reliable perform ...

Posted by narked on Wed, 13 Feb 2019 13:12:18 -0800

kafka Error Failed to send messages after 3 tries Solution

Originally, I was going to try to play with kafka server by myself, but I didn't expect to hit nails when I came up, so I couldn't toss around for a long time. Environmental Science: kafka 2.9.2 - 0.0.2.2 Phenomenon: Create themes and produce data within the server No problem receiving with the same server Call kafka with java on another ...

Posted by utahcon on Sat, 09 Feb 2019 18:09:22 -0800

[Error] The node/hbase is not in ZooKeeper, Hbase port occupancy cannot start normally

After starting zookeeper, I started HDFS, and finally started Hbase. I found that HMaster process was not displayed in JPS process, as follows: [hadoop@hadoop000 bin]$ jps 3936 NameNode 4241 SecondaryNameNode 6561 Jps 4041 DataNode 3418 QuorumPeerMain Then. / hbase shell finds the following error: This is my previous hbase-site.xml confi ...

Posted by intenseone345 on Thu, 07 Feb 2019 10:15:18 -0800

Zookeeper learning (5): java connection zookeeper

Before adding the connected Semaphore semaphore: It has been reported that the connection failed, many posts on the Internet said that the firewall of the server where zookeeper is located is not closed, or the jdk version is inconsistent, and so on. My own analysis of the feeling is as follows: Although I've put ZooKeeper's ...

Posted by bravo81 on Sat, 02 Feb 2019 13:09:16 -0800

Hadoop 2.6+Zookper3.4+Hbase 1.0 Deployment and Installation

Following hadoop fully distributed installation After that, zookper+hbase security is combined. Continue with the previous environment configuration. I. zookper Installation 1.1 Download and Unzip Software cd /software wget -c http://apache.fayea.com/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz tar -zxf zookeeper-3.4.1 ...

Posted by berrberr on Thu, 31 Jan 2019 14:30:16 -0800

Large Data Notebook 06-YARN Construction and Case Study

YARN The construction of yarn Cluster planning To configure Test case wordcount Use the test case wordcount provided by MapReduce The construction of yarn Cluster planning To configure Modify the configuration file mapred-sitex.xml <property> <name>mapreduce.framework.name</name> <value& ...

Posted by marli on Wed, 30 Jan 2019 11:00:15 -0800

Spring+zookeeper+dubbo to build the framework of micro-service project

The whole project source code has been submitted to Github, you can see: Project source address 1. First of all, the project structure is built. Hierarchical multi-module web project (micro-service architecture)Spring MVC+Spring+mybatis-plus integrated redis commons-parent is the version information of the maven jar package for the parent proj ...

Posted by sajy2k on Tue, 29 Jan 2019 15:57:16 -0800

Kafka (12): integration of Kafka and flume

I. Realizing Functions Flume monitors a log file and sends the data to kafka, and then another flume gets the data from kafka. II. Implementation steps 1. environment flume1.6.0 kafka_2.10-0.8.2.1 zookeeper3.4.5 2.flume monitors logs and sends them to kafka's configuration file test1_1.6.conf [reference: http://archive. ...

Posted by cutups on Tue, 29 Jan 2019 11:15:15 -0800

Simple Application Example of java Kafka

There are many ways to install kafka: 1. Single-machine mode (divided into windows mode; linux mode); 2. Pseudo-distributed mode; 3. Distributed mode; Specific building methods for reference: https://blog.csdn.net/xlgen157387/article/details/77312569?utm_source=blogxgwz0 The following is the stand-alone mode under Linux: 1. In ...

Posted by phpusers on Mon, 28 Jan 2019 00:33:17 -0800

storm drpc example

order This article mainly demonstrates an example of storm drpc To configure version: '2' services: supervisor: image: storm container_name: supervisor command: storm supervisor -c storm.local.hostname="192.168.99.100" -c drpc.servers='["192.168.99.100"]' -c drpc.port=3772 -c drpc.invocations.port=3773 -c drpc.http.p ...

Posted by temidayo on Sun, 27 Jan 2019 14:33:15 -0800