Programmer Group

1. description This document is for docker swarm operations. The system for is a local test system. The machine information is as follows, 172.16.1.13 is the manager of docker swarm.   Machine list information for local test: host name Simulated extranet Intranet IP To deploy a module mini01 10.0.0.11 172.16.1.11 tomcat [swar ...

Customize JAVA class and inherit BaseRegionObserver package com.charley.example.hbase2es; import org.apache.hadoop.hbase.Cell; import org.apache.hadoop.hbase.CellUtil; import org.apache.hadoop.hbase.CoprocessorEnvironment; import org.apache.hadoop.hbase.client.Durability; import org.apache.hadoop.hbase.client.Put; import ...

Last blog shared mapreduce's programming ideas. In this section, the blogger will take his friends to understand the principle of wordcount program and the details of code implementation / operation. Through this section, we can have a general understanding of map reduce program. In fact, map and reduce programs in hadoop are only two of them. ...

Overview of Hive Hive is a Hadoop-based data warehouse tool that maps structured data files to a table and provides SQL-like query capabilities. Hive is essentially a MapReduce program that converts HQL. Data processed by Hive is stored in HDFS, and the underlying implementation of analytic data can be MapReduce, tes, or Spark, with its executo ...

1.HBase installation configuration, using independent zookeeper 2. Modify environment variables:The first machine is planned to be master, the second machine is RegionServer, and then start RegionServer on the first machineMake a cluster1 master2 RegionServer Execute vi /etc/profile on the machine, and add the following:export HBASE_HOME=/usr/ ...

The format of the log is as follows: required fields, the second column: mobile number (user), the third last column: uplink traffic, the second last column: downlink popular Train of thought: Encapsulate the uplink traffic, downlink traffic and total traffic into an object bean. In the map, context.write (cell phone number ...

Machine distribution hadoop1 192.168.56121 hadoop2 192.168.56122 hadoop3 192.168.56123 Preparing the installation package jdk-7u71-linux-x64.tar.gz zookeeper-3.4.9.tar.gz hadoop-2.9.2.tar.gz Upload the installation package to the / usr/local directory of three machines and extract it Configure hosts echo "192.168.56.121 hadoop1" >> /etc/ ...

                    ; The Hadoop cluster depends on the following software: jdk, ssh, etc., so as long as these two items and Hadoop related packages are put into the image; Profile preparation 1. Hadoop related configuration files: core-site.xm ...

Ubuntu 16 configuration Hadoop 2.85 Set ssh password free login sudo apt-get install openssh-server #Install SSH server $ ssh localhost #Log in SSH, enter yes for the first time $ exit #Exit ssh localhost logged in $ cd ~/.ssh/ #If you ...

First, set up the hadoop environment under win10, hadoop can runExtract the installation package and source package of Hadoop 2.7.7, create an empty directory after decompression, and copy all the jar packages under the unpacked source package and other packages except kms directory package under share/hadoop under the installation package to ...