基于RabbitMQ的RPC通信

基于RabbitMQ的RPC通信

当需要调用局域网中的服务时,可以用frp进行穿透,也可以在公网搭建RabbitMQ服务器做消息中转,本文演示了这个步骤。

版本信息

属性 值
RabbitMQ 3.13.0
pika 1.3.1
python 3.6.8
CPU 2颗 Intel® Xeon® Gold 6248R CPU @ 3.00GHz

操作步骤

搭建RabbitMQ(默认用户名:guest 密码:guest )

bash 复制代码
docker run -d --name rabbitmq -p 5671:5671 -p 5672:5672 -p 4369:4369 \
				-p 25672:25672 -p 15671:15671 -p 15672:15672 rabbitmq:management

服务端实现(srv.py)

python 复制代码
# -*- coding:utf-8 -*-
import pika
import time
import sys
import os

def request_handler(message):
    #content=message.decode('utf-8')
    #print(content)
    return message
    
def on_request(ch, method, props, body):
    response = request_handler(body)
    ch.basic_publish(exchange="",
                     routing_key=props.reply_to,
                     properties=pika.BasicProperties(
                         content_encoding='utf-8',
                         correlation_id=props.correlation_id,
                     ),
                     body=str(response))
    ch.basic_ack(delivery_tag=method.delivery_tag)

while True:
    try:
        credentials = pika.PlainCredentials("guest", "guest")
        connection = pika.BlockingConnection(pika.ConnectionParameters("127.0.0.1",port=5672, credentials=credentials))
        channel = connection.channel()
        channel.queue_declare(queue="rpc_queue")    
        channel.basic_consume("rpc_queue", on_request)
        print(" waiting requests")
        channel.start_consuming()
    except:
        print("error restart")
        pass
    time.sleep(1)

客户端实现(client.py)

python 复制代码
# -*- coding:utf-8 -*-
import os
import io
import time
import uuid
import sys
import requests
import warnings
import numpy as np
import pika
import time
import sys
import traceback
import json
import queue
import uuid
import time
import argparse

class MqRpcClient(object):
    def __init__(self):
        credentials = pika.PlainCredentials("guest", "guest")
        self.connection = pika.BlockingConnection(pika.ConnectionParameters("127.0.0.1",port=5672, credentials=credentials))
        self.channel = self.connection.channel()
        result = self.channel.queue_declare(queue="", exclusive=True)
        self.callback_queue = result.method.queue
        self.channel.basic_consume(self.callback_queue, self.on_response, True)

    def on_response(self, ch, method, props, body):
        if self.corr_id == props.correlation_id:
            self.response = body

    def send(self, message,timeout=5):
        self.response = None
        self.corr_id = str(uuid.uuid4())
        self.channel.basic_publish(exchange="",
                                   routing_key="rpc_queue",
                                   properties=pika.BasicProperties(
                                       reply_to=self.callback_queue,
                                       content_encoding='utf-8',
                                       correlation_id=self.corr_id,
                                   ),
                                   body=message.encode('utf-8')) 
        t0=time.time()
        while self.response is None:
            self.connection.process_data_events()
            t1=time.time()
            if t1-t0>timeout:
                return None
        return self.response

def send_message(message,loop):
    rpc = MqRpcClient()
    t0=time.time()
    for i in range(loop):
        response = rpc.send(message,1)
        if response is None and response==message:
            print("Failed")
            break
    t1=time.time()
    print("qps:{:.2f}".format(loop/(t1-t0)))
    return True

if __name__ == "__main__":
    parse = argparse.ArgumentParser()
    parse.add_argument('--msg', type=str, default='', help='')
    parse.add_argument('--loop', type=int, default=1, help='')
    args = parse.parse_args()
    send_message(args.msg,args.loop)

性能测试(4919 qps)

bash 复制代码
# 安装依赖
pip3 install pika==1.3.1

# 启动服务端(服务端收到请求后,直接回复)
python3 srv.py &

# 客户端多路请求,测试总吞吐
cat <<EOF | tee rpc.sh
for i in \`seq 0 \$1\`
do
  python3 client.py  --msg HelloWorld --loop 1000 &
done
wait
EOF
bash rpc.sh  16 | awk -F: '{SUM+=$2};END{print SUM}'
相关推荐
Pniubi9 天前
基于RabbitMQ实现延迟队列
rabbitmq
一条泥憨鱼11 天前
【消息队列】ACK确认了什么:消息队列可靠投递的完整链路
java·后端·kafka·消息队列·rabbitmq
小园子的小菜12 天前
Netty 核心组件 Channel、ChannelHandler 与简易 RPC 架构实战详解
网络协议·rpc·架构
后台模板学习13 天前
Kafka 与 RabbitMQ 在用户认证与权限管理场景
kafka·rabbitmq·linq
装不满的克莱因瓶14 天前
支付订单成功异步MQ权益发放设计和开发
java·架构·系统架构·rabbitmq·硬件架构
千里达景区票务系统14 天前
消息队列选型对比:RabbitMQ vs RocketMQ vs Kafka
kafka·消息队列·rabbitmq·rocketmq
聪明蛋子哟14 天前
高扩展性AI应用架构指南:融合RAG检索、Agent编排与OpenAPI/RPC工具网关的设计模式
人工智能·rpc·架构
小此方15 天前
C++ 工程组件与基础设施(三)详解RPC服务的概念与安装,图片介绍Brpc服务器和客户端的搭建过程
服务器·c++·rpc
笨鸟先飞的橘猫16 天前
混合流量导致 RPC 消息队列堆积
rpc·线上问题查证
阿正的梦工坊17 天前
深入理解 JSON-RPC 2.0:轻量级远程调用协议详解
rpc·json