Programmer Group

catalogue1 HFDS core parameters1.1 NameNode memory production configurationProblem descriptionConfiguration in hadoop-env.sh1.2 NameNode heartbeat concurrency configurationModify hdfs-site.xml configuration1.3 enable recycle bin configurationRecycle bin mechanismDescription of function parameters for opening recycle binStart Recycle Bin - modif ...

catalogueYarn capacity scheduler multi queue submission casedemandConfigure capacity scheduler for multiple queues1. Modify the following configurationUpload and download of SecureCRT2 upload to the cluster and distribute3 restart Yarn or yarn rmadmin -refreshQueues4 submit tasks to Hive queueSubmission method - jar packageTask priorityUse of t ...

Data import 1. Load data into the table (load) 1) Grammar hive> load data [local] inpath 'Data path' [overwrite] into table \ student [partition (partcol1=val1,...)]; (1) load data: indicates loading data (2) Local: indicates loading data from local to hive table; Otherwise, load data from HDFS to hive table (3) inpath: indicates the pa ...

In fact, the construction methods of fully distributed and pseudo distributed are basically the same. Only individual files need to be changed. Let's start now! The first step is to configure the IP address, host name, and the mapping between host and IP address. The tutorial is included in my previous pseudo distributed building, which will n ...

hadoop startup error ERROR: Cannot set priority of datanode process The cluster was not formatted ./bin/hdfs namenode -format Modify yarn default port After that, it needs to be restarted because it is not hot database Error reporting 1045 [root@test ~]# systemctl stop mariadb ##Close mysql [root@test ~]# mysqld_safe --skip-grant-tables ...

Previously, I planned to directly install and configure the flink service on ambari to facilitate management, but I found that the flink integrated by ambari would have many problems, which would be inconvenient to manage (maybe I didn't find the correct method), so I planned to configure the service separately Download two files Flink-1.10.1 ...

1, Install docker 1. Download offline package Index of linux/static/stable/x86_64/ 2. Decompression tar -xzvf docker-18.06.3-ce.tgz (ce version means community free version, please specify   The difference between docker with ce and without ce) 3. Copy the extracted folder to the / usr/local directory cp docker-18.06.3-ce /usr/local ...

2021SC@SDUSC 1, HBase overview What is HBase HBase is a database system built on HDFS, which provides high reliability, high performance, column storage, scalability and real-time reading and writing. It is mainly used to store unstructured and semi-structured loose data. HBase uses hadoop HDFS as its file storage system, Hadoop MapReduc ...

Hi Wen Ledao's large TV series "when is davinci updated" finally came to an end in the early autumn of 21 years, followed by the official release of the popular new product datart (Digital Art). This year, we can see that there are many such people in the group     So..   And so on..   What else?   Wha ...

  This document is compiled with reference to the official website of Hadoop and many other materials. For neat typesetting and comfortable reading, blurred and unclear pictures and black-and-white pictures are redrawn into high-definition color pictures. At present, Hadoop 2. X is widely used in enterprises, so this article focuses on Hado ...