YDB is deployed in Mini Centos environment based on haoop, zookeeper and kafka
YDB is deployed in Mini Centos environment based on haoop, zookeeper and kafka
YDB introduction
YDB full name Yan Yun YDB It is a real-time, multi-dimensional, interactive query, statistics and analysis engine based on Hadoop distributed architecture. It has second-level performance under trillion data scale and stable and reliable perform ...
Posted by narked on Wed, 13 Feb 2019 13:12:18 -0800
kafka Error Failed to send messages after 3 tries Solution
Originally, I was going to try to play with kafka server by myself, but I didn't expect to hit nails when I came up, so I couldn't toss around for a long time.
Environmental Science:
kafka 2.9.2 - 0.0.2.2
Phenomenon:
Create themes and produce data within the server
No problem receiving with the same server
Call kafka with java on another ...
Posted by utahcon on Sat, 09 Feb 2019 18:09:22 -0800
[Error] The node/hbase is not in ZooKeeper, Hbase port occupancy cannot start normally
After starting zookeeper, I started HDFS, and finally started Hbase. I found that HMaster process was not displayed in JPS process, as follows:
[hadoop@hadoop000 bin]$ jps
3936 NameNode
4241 SecondaryNameNode
6561 Jps
4041 DataNode
3418 QuorumPeerMain
Then. / hbase shell finds the following error:
This is my previous hbase-site.xml confi ...
Posted by intenseone345 on Thu, 07 Feb 2019 10:15:18 -0800
Zookeeper learning (5): java connection zookeeper
Before adding the connected Semaphore semaphore:
It has been reported that the connection failed, many posts on the Internet said that the firewall of the server where zookeeper is located is not closed, or the jdk version is inconsistent, and so on.
My own analysis of the feeling is as follows:
Although I've put ZooKeeper's ...
Posted by bravo81 on Sat, 02 Feb 2019 13:09:16 -0800
Hadoop 2.6+Zookper3.4+Hbase 1.0 Deployment and Installation
Following hadoop fully distributed installation After that, zookper+hbase security is combined.
Continue with the previous environment configuration.
I. zookper Installation
1.1 Download and Unzip Software
cd /software
wget -c http://apache.fayea.com/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz
tar -zxf zookeeper-3.4.1 ...
Posted by berrberr on Thu, 31 Jan 2019 14:30:16 -0800
Large Data Notebook 06-YARN Construction and Case Study
YARN
The construction of yarn
Cluster planning
To configure
Test case
wordcount
Use the test case wordcount provided by MapReduce
The construction of yarn
Cluster planning
To configure
Modify the configuration file mapred-sitex.xml
<property>
<name>mapreduce.framework.name</name>
<value& ...
Posted by marli on Wed, 30 Jan 2019 11:00:15 -0800
Spring+zookeeper+dubbo to build the framework of micro-service project
The whole project source code has been submitted to Github, you can see: Project source address
1. First of all, the project structure is built.
Hierarchical multi-module web project (micro-service architecture)Spring MVC+Spring+mybatis-plus integrated redis
commons-parent is the version information of the maven jar package for the parent proj ...
Posted by sajy2k on Tue, 29 Jan 2019 15:57:16 -0800
Kafka (12): integration of Kafka and flume
I. Realizing Functions
Flume monitors a log file and sends the data to kafka, and then another flume gets the data from kafka.
II. Implementation steps
1. environment
flume1.6.0
kafka_2.10-0.8.2.1
zookeeper3.4.5
2.flume monitors logs and sends them to kafka's configuration file test1_1.6.conf
[reference: http://archive. ...
Posted by cutups on Tue, 29 Jan 2019 11:15:15 -0800
Simple Application Example of java Kafka
There are many ways to install kafka:
1. Single-machine mode (divided into windows mode; linux mode);
2. Pseudo-distributed mode;
3. Distributed mode;
Specific building methods for reference: https://blog.csdn.net/xlgen157387/article/details/77312569?utm_source=blogxgwz0
The following is the stand-alone mode under Linux:
1. In ...
Posted by phpusers on Mon, 28 Jan 2019 00:33:17 -0800
storm drpc example
order
This article mainly demonstrates an example of storm drpc
To configure
version: '2'
services:
supervisor:
image: storm
container_name: supervisor
command: storm supervisor -c storm.local.hostname="192.168.99.100" -c drpc.servers='["192.168.99.100"]' -c drpc.port=3772 -c drpc.invocations.port=3773 -c drpc.http.p ...
Posted by temidayo on Sun, 27 Jan 2019 14:33:15 -0800