Selection and comparison of message oriented middleware MQ

One 、 frequently-used MQ：
1.1 At present commonly used MQ Yes ：RocketMq、Kafka、RabbitMq、 The latest one pulsar; a MQ At least meet Low latency , High throughput , Data accumulation capacity Three characteristics

Two 、 frequently-used MQ Comparison of ：
Generally from function 、 performance 、 other Three dimensions

• RabbitMq:Erlang Language development , Support priority queue , The disadvantage is that the message stacking capacity is weak , Performance is the weakest , The throughput of a single machine is 10000 , and rocketmq It's 100000 ,kafka In millions .
• rocketMq:JAVA Language development , Support message query
• kfaka:java And scala Language , High throughput connection , It is mostly used in big data scenarios , High data throughput may cause data loss

summary ：
If the business scenario is available rocketMQ And rabbitMQ, If it is a big data scenario kafka; as for rocketMQ And rabbitMQ How to choose , Depending on the technology stack , If it is Erlang The language is chosen as much as possible rabbitmq, If it is java Language , Choose rocketMQ.

If the sensitivity of the message is not high , Allow less data loss , You can choose kafka; If the sensitivity requirement of the message is high, do not select kafka; If the message sensitivity requirements are extremely high , select rocketMq, because rocketMq It has the function of message query .

3、 ... and 、 mq Why so soon? ：
Memory mapping （ Write to memory first , Increase of efficiency ）, Efficient storage design （ Fixed file length , You can use subscripts to quickly locate ）, Synchronous brush set （ But the internal is asynchronous batch disk brushing ）, Memory level read / write separation and locking mechanism

Four 、 Message not lost
Synchronous brush set , Synchronous replication

notes ： This paper mainly compares three kinds of message oriented middleware , If you want to know MQ For more information, please visit the following two articles ：
RabbitMQ Brief description and docker install ： Portal
actual combat ：springboot Integrate rabbitMQ： Portal