Installation of big data platform HDP3.1.4(Ambari2.7.4)

Keywords: CentOS cloud computing Alibaba Cloud

This article introduces the installation of hdp3.14 + ambari 2.7.4. If you want to use other versions, you can go to the official website to query the version adaptation

Cloudera Support Matrix

In addition, the official website also provides detailed guidance on the installation process, which can be referred to the official website Installation

Article catalog

Article introduction

HADOOP mainly has three versions,

  • Apache: native version. All distributions are improved based on this version,
  • Cloudera's Distribution Including Apache Hadoop (CDH)
  • Hortonworks Version (Hortonworks Data Platform, HDP for short, has been acquired by CDH)


Machine node3 sets
Installation packageambari,HDP,HDP-UTILS

Preparation details

Environment and setting of three machines

The three nodes are CentOS 7 systems, namely hdp01, hdp02 and hdp03

Modify local name

hostnamectl set-hostname hdp01

After setting, you can view the modified local name


All three machines have vim /etc/hosts files, so that the three machines can be accessed through hdp01, hdp02 and hdp03

ip1 hdp01
ip2 hdp02
ip3 hdp03

After modification, test whether the corresponding server can be found by ping the host name

ping ip1

2. Installation package

ambari and hdp have large packages, and because they are foreign websites, the download speed is moving. Unfortunately, the hdp official website has to charge, so we use Xunlei download

After downloading, upload to the hdp server instead of the other two servers

3. Environment

  • All three machines have java8 installed
  • hdp01 this machine is installed with mysql7
  • Password free login from hdp01 to hdp02 and hdp03

4. Installation

1.hdp01 installing httpd service

yum -y install httpd #install

systemctl start httpd #start-up

systemctl status httpd #View startup status

chkconfig httpd on #Set startup

2. After httpd is installed, you can see that / var/www/html exists in the original directory

We unzip the uploaded ambari, HDP and HDP-UTILS to this directory

tar -zxvf ambari- -C /var/www/html/
tar -zxvf HDP- -C /var/www/html/
tar -zxvf HDP-UTILS- -C /var/www/html/

3. Configure basic source

Under / etc/yum.repos.d /

Create ambari.repo


name=HDP Version - HDP-

name=HDP-UTILS Version - HDP-UTILS-

To install createrepo:

yum install yum-utils createrepo yum-plugin-priorities -y

Generate local source

createrepo  ./

Clear yum cache

yum clean all
yum makecache
yum repolist

Copy the ambari.repo created earlier to hdp02,hdp03

scp ambari.repo hdp02:$PWD
scp ambari.repo hdp03:$PWD

Install ambari server

Execute on hdp01

yum -y install ambari-server

Initialize ambari

ambari-server setup

Create the ambari database in the previously installed database and initialize the ambari database

create database ambari;
use ambari;
source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql

Start ambari. If the service starts successfully, it will listen to port 8080. If it fails, you can view the log / var / log / ambari server / ambari server.log

ambari-server start

Use the browser to log in, and the account and password admin/admin log in normally, then the installation is completed


Give the cluster a name

Posted by jamiet757 on Tue, 30 Nov 2021 02:14:10 -0800