Installing and deploying RocketMQ for Linux

Keywords: Linux Operation & Maintenance server


One of Alibaba's core distributed technologies is RocketMq. As a distributed message middleware, it has been baptized by Taobao's double 11 and far exceeds activeMq in function and performance

1. You should know that RocketMQ native supports distributed, while ActiveMQ native has a single point.

2.RocketMQ can guarantee strict message order, but ActiveMQ cannot!

3.RocketMQ provides the ability to accumulate 100 million messages. This is not the focus. The focus is to keep the write latency low after accumulating 100 million messages!

4. Rich message pull mode (Push or Pull)
    Push is easy to understand, such as setting the Listener callback on the consumer side; In Pull, the control power lies in the application, that is, the application needs to actively call the Pull message method to obtain messages from the Broker. There is a problem of consumption location recording (if it is not recorded, it will lead to repeated consumption of messages)

5. In Metaq1.x/2.x, Zookeeper is used for distributed coordination, while RocketMQ implements a NameServer, which is more lightweight and has better performance!

6. Message failure retry mechanism, efficient subscriber horizontal expansion capability, powerful API, transaction mechanism, etc. (described in detail later)

Quoted from:

Installation steps

1. Install JAVA

2. Install RocketMQ

  1. Get RocketMQ

Find the corresponding version on github and get the download link, Click the corresponding version and right-click to get the copy link address to get the

  1. Execute Linux commands
# Enter the download directory
> cd /usr/local
# Download the rocketmq source package through the wget command
> wget
# Unzip the source package
> tar -zxvf rocketmq-all-4.7.1.tar.gz

3. Install Maven

Since the downloaded RocketMQ is the source code, we need to compile the source code. We choose maven to compile it

  1. Get Maven
    Via Maven's official website , find the Maven version to download. Here we choose Maven-3.8.3
  2. Install Maven
# Enter the download directory
> cd /usr/local
# Download maven package through wget command
> wget
# Unzip Maven
> tar -zxvf apache-maven-3.8.3-bin.tar.gz
# Modify Maven configuration file and configure Maven image library
> vim /usr/local/apache-maven-3.8.3/conf/setting.xml

Find the "mirrors" tag pair in Maven configuration file and add the following configuration

	<name>aliyun maven</name>

Next, we configure the Linux environment variables

# View linux configuration file
> vim /etc/profile
# Add the following at the bottom of the file
# Configuration variable MAVEN_HOME
# Configure the PATH. The purpose of adding ${PATH} is to reference the previously configured PATH
export PATH=${PATH}:${MAVEN_HOME}/bin
# Save changes
> [Esc]:wq!
# Manual refresh profile takes effect
> source /etc/profile

We can verify whether maven is installed successfully through mvn -v

# Execute the maven command to -v view the maven version
> mvn -v
# If the following information appears, the installation is successful
Maven home: /usr/local/apache-maven-3.8.3
Java version: 1.8.0_162, vendor: Oracle Corporation, runtime: /usr/local/java/jdk1.8.0_162/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.10.0-1160.11.1.el7.x86_64", arch: "amd64", family: "unix"

Reference documents: Linux environment variable configuration introduction

4. Compile RocketMQ

When the relevant software is configured, we can compile the RoekctMQ source code

# Enter the RokcetMQ directory
> cd /usr/local/rocket-rocketmq-all-4.7.1
# Execute maven compile command
> mvn -Prelease-all -DskipTests clean install -U

The execution result is shown in the figure. If "BUILD SUCCESS" appears, the compilation is successful:

After successful compilation, a new directory will be generated
/usr/local/rocketmq-rocketmq-all-4.7.1/distribution/target/rocketmq-4.7.1 is the compiled RocketMQ
We can choose to move it to another directory for easy operation

# Here I choose to move it to / usr/local
> mv /usr/local/rocketmq-rocketmq-all-4.7.1/distribution/target/rocketmq-4.7.1 /usr/local/rocketmq-4.7.1

5. Start RocketMQ

So far, most of our RocketMQ installation has been completed. At this time, we only need to start normally

# Enter the rocketmq directory
> cd /usr/local/rocket-4.7.1
# Here, we choose to put the log file into / data/mq/krocketmq/nameserver.log, and create the log directory first
> mkdir /data/mq/rocketmq
# Start namesrv
> nohup sh bin/mqnamesrv > /data/mq/rocketmq/nameserver.log 2>&1 &
# Start broker
> nohup sh bin/mqbroker -n -c conf/broker.conf autoCreateTopicEnable=true > /data/mq/rocketmq/broker.log 2>&1 &
# View startup information
> jps -lm

Through jps, we can see the following information, which indicates that rocketmq has been started successfully

There is a small pit here. When you start the broker, you will be prompted with an error, but when you carefully check the error log, you will find that there is not enough memory

This is because the memory allocated by default when rocketmq is started is too large, and the actual memory of the system is not enough to provide such a large memory

Open the file, and we will see the following configuration

We only need to modify the memory allocated at startup
-server -Xms128m -Xmx256m -Xmn256m
Restart the broker after saving the configuration

Reference documents: RocketMQ stepping on the pit

6. Test RocketMQ

Now we need to test whether RocketMQ is working properly

# Configure service address
> export NAMESRV_ADDR=
# Enter the rocketmq directory
> cd /usr/local/rocketmq-4.7.1
# Send sample template
> sh bin/ org.apache.rocketmq.example.quickstart.Producer

# Receive sample messages
> sh bin/ org.apache.rocketmq.example.quickstart.Consumer

Queue message consumption to success

7. Close RocketMQ

# Enter the rocketmq directory
> cd /usr/local/rocketmq-4.7.1
# Stop broker
> sh bin/mqshutdown broker
# Stop nameserver
> sh bin/mqshutdown namesrv

Self starting RocketMQ


Reference documents:

Installing and deploying rocketmq for Linux
Installing rocketmq for linux

Posted by Cronikeys on Mon, 08 Nov 2021 19:29:20 -0800