This article introduces the installation of hdp3.14 + ambari 2.7.4. If you want to use other versions, you can go to the official website to query the version adaptation
In addition, the official website also provides detailed guidance on the installation process, which can be referred to the official website Installation
Article catalog
Article introduction
HADOOP mainly has three versions,
- Apache: native version. All distributions are improved based on this version,
- Cloudera's Distribution Including Apache Hadoop (CDH)
- Hortonworks Version (Hortonworks Data Platform, HDP for short, has been acquired by CDH)
preparation
| Machine node | 3 sets |
| Installation package | ambari，HDP，HDP-UTILS |
Preparation details
Environment and setting of three machines
The three nodes are CentOS 7 systems, namely hdp01, hdp02 and hdp03
Modify local name
hostnamectl set-hostname hdp01
After setting, you can view the modified local name
hostname
All three machines have vim /etc/hosts files, so that the three machines can be accessed through hdp01, hdp02 and hdp03
ip1 hdp01 ip2 hdp02 ip3 hdp03
After modification, test whether the corresponding server can be found by ping the host name
ping ip1
2. Installation package
ambari and hdp have large packages, and because they are foreign websites, the download speed is moving. Unfortunately, the hdp official website has to charge, so we use Xunlei download
http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.4.0/ambari-2.7.4.0-centos7.tar.gz
http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.1.4.0/HDP-3.1.4.0-centos7-rpm.tar.gz
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/HDP-UTILS-1.1.0.22-centos7.tar.gz
After downloading, upload to the hdp server instead of the other two servers
3. Environment
- All three machines have java8 installed
- hdp01 this machine is installed with mysql7
- Password free login from hdp01 to hdp02 and hdp03
4. Installation
1.hdp01 installing httpd service
yum -y install httpd #install systemctl start httpd #start-up systemctl status httpd #View startup status chkconfig httpd on #Set startup
2. After httpd is installed, you can see that / var/www/html exists in the original directory
We unzip the uploaded ambari, HDP and HDP-UTILS to this directory
tar -zxvf ambari-2.7.4.0-centos7.tar.gz -C /var/www/html/ tar -zxvf HDP-3.1.4.0-centos7-rpm.tar.gz -C /var/www/html/ tar -zxvf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/
3. Configure basic source
Under / etc/yum.repos.d /
Create ambari.repo
[ambari-2.7.4.0] name=ambari baseurl=http://hdp01/ambari/centos7/2.7.4.0-118 gpgkey=http://hdp01/ambari/centos7/2.7.4.0-118/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins gpgcheck=1 enabled=1 priority=1 [HDP-3.1.4.0] name=HDP Version - HDP-3.1.4.0 baseurl=http://hdp01/HDP/centos7/3.1.4.0-315/ gpgcheck=1 gpgkey=http://hdp01/HDP/centos7/3.1.4.0-315/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1 [HDP-UTILS-1.1.0.22] name=HDP-UTILS Version - HDP-UTILS-1.1.0.22 baseurl=http://hdp01/HDP-UTILS/centos7/1.1.0.22/ gpgcheck=1 gpgkey=http://hdp01/HDP-UTILS/centos7/1.1.0.22/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1
To install createrepo:
yum install yum-utils createrepo yum-plugin-priorities -y
Generate local source
createrepo ./
Clear yum cache
yum clean all yum makecache yum repolist
Copy the ambari.repo created earlier to hdp02,hdp03
scp ambari.repo hdp02:$PWD scp ambari.repo hdp03:$PWD
Install ambari server
Execute on hdp01
yum -y install ambari-server
Initialize ambari
ambari-server setup
Create the ambari database in the previously installed database and initialize the ambari database
create database ambari; use ambari; source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Start ambari. If the service starts successfully, it will listen to port 8080. If it fails, you can view the log / var / log / ambari server / ambari server.log
ambari-server start
Use the browser to log in, and the account and password admin/admin log in normally, then the installation is completed
Click LAUNCH INSTALL WIZARD
Give the cluster a name