Various daemon States

1. pseudo distribution

• master

  [hadoop@master ~]$ jps
  3878 Jps
  3800 DataNode
  3433 NameNode
  3629 SecondaryNameNode

2. Fully distributed

2.1 Do not open yarn

• master

[hadoop@master ~]$ jps
3878 Jps
3433 NameNode
3629 SecondaryNameNode

• slave01

[hadoop@slave01 ~]$ jps
3516 Jps
3262 DataNode

• slave02

[hadoop@slave02 ~]$ jps
25135 DataNode
25391 Jps

• slave03

[hadoop@slave03 ~]$ jps
3172 Jps
2905 DataNode

2.2 Open yarn (MRAppMaster and YarnChild are available only with MapReduce tasks)

• master

[hadoop@master ~]$ jps
3878 Jps
3800 ResourceManager
3433 NameNode
3629 SecondaryNameNode

• slave01

[hadoop@slave01 ~]$ jps
3398 NodeManager
3516 Jps
3262 DataNode

• slave02

[hadoop@slave02 ~]$ jps
25273 NodeManager
25135 DataNode
25391 Jps

• slave03

[hadoop@slave03 ~]$ jps
3172 Jps
2905 DataNode
3054 NodeManager

3. Fully Distributed (High Availability)

3.1 Manual Disaster Recovery

3.1.1 No yarn

• master

  master ~]$ jps
  5934 NameNode
  6047 Jps

• smaster

  [hadoop@smaster tmp]$ jps
  4974 NameNode
  5214 Jps

• slave01

  [hadoop@slave01 .ssh]$ jps
  4962 Jps
  4595 DataNode
  4692 JournalNode

• slave02

  [hadoop@slave02 ~]$ jps
  4569 JournalNode
  4618 Jps
  4475 DataNode

• slave03

  [hadoop@slave03 .ssh]$ jps
  4210 JournalNode
  4259 Jps
  4116 DataNode

3.1.2 Open yarn

• master

  [hadoop@master ~]$ jps
  7412 Jps
  6970 NameNode
  7260 ResourceManager

• smaster

  [hadoop@smaster tmp]$ jps
  4974 NameNode
  5214 Jps

• slave01

  [hadoop@slave01 .ssh]$ jps
  5360 Jps
  5070 DataNode
  5166 JournalNode
  5263 NodeManager

• slave02

  [hadoop@slave02 ~]$ jps
  5175 DataNode
  5271 JournalNode
  5367 NodeManager
  5465 Jps

• slave03

  [hadoop@slave03 .ssh]$ jps
  4818 DataNode
  5010 NodeManager
  4914 JournalNode
  5113 Jps

3.2 Zookeeper Automatic Disaster Recovery

3.2.1 No yarn

• master

  [hadoop@master hadoop]$ jps
  10067 DFSZKFailoverController
  10298 Jps
  10220 NameNode

• smaster

  [hadoop@smaster current]$ jps
  6945 NameNode
  8196 Jps
  8101 DFSZKFailoverController

• slave01

  [hadoop@slave01 zookeeper]$ jps
  6418 Jps
  5708 QuorumPeerMain
  6045 DataNode
  6143 JournalNode

• slave02

  [hadoop@slave02 zookeeper]$ jps
  6422 Jps
  5784 QuorumPeerMain
  6124 DataNode
  6222 JournalNode

• slave03

  [hadoop@slave03 zookeeper]$ jps
  5424 QuorumPeerMain
  5746 DataNode
  5844 JournalNode
  6056 Jps

3.2.2 Open yarn

• master

  [hadoop@master hadoop]$ jps
  10067 DFSZKFailoverController
  10298 Jps
  10220 NameNode

• smaster

  [hadoop@smaster current]$ jps
  6945 NameNode
  8242 ResourceManager
  8101 DFSZKFailoverController
  8491 Jps

• slave01

  [hadoop@slave01 zookeeper]$ jps
  6467 NodeManager
  6585 Jps
  5708 QuorumPeerMain
  6045 DataNode
  6143 JournalNode

• slave02

  [hadoop@slave02 zookeeper]$ jps
  6471 NodeManager
  5784 QuorumPeerMain
  6124 DataNode
  6589 Jps
  6222 JournalNode

• slave03

  [hadoop@slave03 zookeeper]$ jps
  5424 QuorumPeerMain
  5746 DataNode
  5844 JournalNode
  6228 Jps
  zookeeper]$ jps

  6471 NodeManager
  5784 QuorumPeerMain
  6124 DataNode
  6589 Jps
  6222 JournalNode

• slave03

  [hadoop@slave03 zookeeper]$ jps
  5424 QuorumPeerMain
  5746 DataNode
  5844 JournalNode
  6228 Jps
  6105 NodeManager