Programmer Group

Hive can only be installed on one node 1. Upload tar package 2. Decompression tar -zxvf hive-1.2.1.tar.gz -C /apps/ 3. Install mysql database (switch to root user) (there are no limitations on where to install, only nodes that can connect to the hadoop cluster) 4. Configure hive (a) Configure the HIVE_HOME environment variable vi conf/hive-e ...

**System Configuration** ** Specification: ** 1vCPUs | 2GB | s6.medium.2 ** Mirror: ** Ubuntu 18.04 server 64bit **User: ** Create a halo user on Ubuntu Preparatory software: 1 Hadoop installation package (recommended cdh, cloudera site) 2 Java 1.8 +3 ssh 1. Install Java Download the Linux version of JDK jdk-8u161-linux-x64.tar.gz first Un ...

After moving the hadoop cluster on the local virtual machine to Baidu cloud server, I found that there are always many unknown ip addresses logging in to my server, because the firewall is closed locally, but in the actual deployment, this is too unsafe. So I spent two hours setting up the firewall of t ...

Article directory Preface Original layout of zone datanode chunk file Ozone Datanode Chunk Layout: File > per > chunk and file > per > block The actual storage comparison between the old and new layout s of Chunk Quote Preface In zone, the file object data of zone is organized in th ...

1. Installation address 1) Flume official website address http://flume.apache.org/ 2) Document view address http://flume.apache.org/FlumeUserGuide.html 3) Download address http://archive.apache.org/dist/flume/ 2. Installation and deployment 1) Upload apache-flume-1.7.0-bin.tar.gz to the / opt/softwa ...

Write at the beginning: Finally I copied the svm job of the big guys again. It's up to me to copy it. I'll attach a link to the big guys who talked better to me in the response location. Thank them. Recently, facing the pressure of finding an internship, this employment is still very high, what can I d ...

1, Last course review 2, Linux basic command 3 2.1 users and user groups 2.2. Use of personal environment variables (. Selection of bashrc and. Bash? Profile) and global environment variables (/ etc/profile) and aliases 2.3 use of history command 2.4 use of delete command Three. Homework 1, Last cour ...

Inherit Mapper's generics public class WCMapper extends Mapper<LongWritable, Text, Text, LongWritable> Longwritable - > start offset Text - > entered text Text - > output text Longwritable - > count Of the four generics, the first two are the type of specified mapper input data, the key is the type of input key, ...

Preface Implement a handwritten WC program and package it to run on the cluster. Create a Maven project and import pom Engineering catalogue Import pom <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/X ...

1. Environmental preparation On a linux machine, install the hadoop running environment. For the installation method, see: Establishment of HADOOP operation environment 2. Start HDFS and run MapReduce 2.1. Configure cluster 1. Configuration: hadoop-env.sh Get the installation path of JDK in Linux system: [root@ hadoop101 ~]# echo $JAVA_HOME /op ...