1. 总体架构图(一眼看懂)
┌------------------┐ 1.本地事务 ┌------------------┐
│ 订单服务 │ ---►DB+event表(同一事务)---► │ 定时补偿任务 │
│ (producer) │ └------------------┘
│ │ 2.发送消息 ▲
│ ├-------------------------------►│┌------------------┐
│ │ 3.ConfirmCallback ack/nack │ │ rabbit mq │
│ │◄-------------------------------┤└------------------┘
└------------------┘ │
│ │
│ 5.补偿/回滚 4.消费失败/业务校验失败 │
▼ ▼
┌------------------┐ 6.对账任务 ┌------------------┐
│ 补偿/对账服务 │------------------------►. │ 库存/账户服务 │
└------------------┘ └------------------┘
2. 角色与职责清单
组件 | 职责 | 关键技术点 |
---|---|---|
订单服务 | 1. 本地事务落库+写事件表 2. 发送消息并监听 confirm | @Transactional +Publisher Confirm |
事件表 | 仅 5 列即可:id,biz_id,event_type,payload,status,create_time |
状态枚举:UNSENT/SENT/DONE |
补偿任务 | 扫 UNSENT 重投;扫 DLX 报警;触发补偿消息 | @Scheduled(fixedDelay=5s) |
库存服务 | 1. 幂等消费 2. 业务校验失败 立即发补偿消息 3. 技术异常抛异常触发重投 | 唯一索引/SETNX +手动 basicAck/Nack |
对账任务 | 每日离线 FULL JOIN 业务表 vs 事件表;输出差异 | SQL/Spark 均可 |
补偿服务 | 监听补偿队列,做"冲正":关闭订单、退款、加回库存 | 普通消费者,逻辑与业务反向 |
3. 生产端:可靠投递(代码级)
yaml
spring:
rabbitmq:
publisher-confirm-type: correlated # 开启 confirm
java
@Transactional
public void createOrder(OrderDTO dto){
// 1. 落单
Order order = orderDao.insert(dto);
// 2. 同一事务写事件
eventDao.insert(Event.builder()
.bizId(order.getId())
.eventType("ORDER_CREATED")
.payload(JSON.toJSONString(dto))
.status("UNSENT")
.build());
}
// 3. 事务提交后异步发消息
@EventListener(TransactionPhase.AFTER_COMMIT)
public void sendAfterTx(OrderCreatedEvent event){
Event evt = eventDao.findByBizId(event.getOrderId());
CorrelationData cd = new CorrelationData(evt.getId());
rabbitTemplate.convertAndSend(
"order.event.exchange",
"stock.reduce",
evt.getPayload(),
cd);
}
// 4. ConfirmCallback 更新状态
rabbitTemplate.setConfirmCallback((cd, ack, cause) -> {
if (ack) {
eventDao.updateStatus(cd.getId(), "SENT");
} else {
log.warn("消息未送达 broker, 等定时任务补偿");
}
});
4. 消费端:幂等 + 业务失败补偿
java
@RabbitListener(queues = "stock.reduce.queue")
public void handle(Message msg, Channel channel,
@Header(AmqpHeaders.DELIVERY_TAG) long tag) throws IOException {
String orderId = JSON.parseObject(msg.getBody()).getString("orderId");
int quantity = JSON.parseObject(msg.getBody()).getIntValue("quantity");
try {
// 1. 幂等判断(唯一索引)
if (stockDao.alreadyDeduct(orderId)) {
channel.basicAck(tag, false);
return;
}
// 2. 真正扣减
boolean ok = stockDao.deduct(orderId, quantity);
if (!ok) { // 库存不足------业务失败
sendCompensate(orderId, "STOCK_LACK");
}
channel.basicAck(tag, false);
} catch (Exception e) { // 技术异常
channel.basicNack(tag, false, true); // 重新投递
}
}
private void sendCompensate(String orderId, String reason){
CompensateCmd cmd = new CompensateCmd(orderId, reason);
rabbitTemplate.convertAndSend("compensate.exchange", "order.cancel", cmd);
}
5. 补偿服务(所谓"回滚")
java
@RabbitListener(queues = "order.cancel.queue")
public void handleCancel(CompensateCmd cmd) {
Order order = orderDao.find(cmd.getOrderId());
if (order == null || order.getStatus() == "CLOSED") return;
// 1. 关闭订单
orderDao.updateStatus(cmd.getOrderId(), "CLOSED");
// 2. 退款
accountService.refund(order.getUserId(), order.getAmount());
// 3. 释放库存(幂等)
stockDao.addBack(cmd.getOrderId());
// 4. 事件表记 DONE,防止再对账
eventDao.updateStatus(cmd.getOrderId(), "DONE");
}
6. 对账任务(离线)
sql
-- 每日凌晨运行
INSERT INTO diff_${biz_date}
SELECT
COALESCE(b.order_id, m.biz_id) AS order_id,
CASE WHEN b.order_id IS NULL THEN 'ONLY_MSG'
WHEN m.biz_id IS NULL THEN 'ONLY_BIZ'
ELSE 'STATUS_MISMATCH' END AS type
FROM biz_order b
FULL JOIN event_msg m ON b.order_id = m.biz_id
WHERE b.order_date = ${biz_date}
AND (b.order_id IS NULL OR m.biz_id IS NULL OR b.status != m.status);
ONLY_BIZ
→ 补发消息ONLY_MSG
→ 发补偿消息关闭订单- 差异 >0 条即钉钉 @oncall
7. 异常场景全覆盖
场景 | 表现 | 兜底手段 |
---|---|---|
本地事务失败 | 订单都没落库 | 无消息,业务方自己回滚 |
confirm 丢失 | 事件表仍 UNSENT | 定时任务 5s 重扫重投 |
消费端技术异常 | 代码 NPE | 重新投递(requeue=true) |
消费端业务失败 | 库存不足 | 立即发补偿消息 + ack |
消息一直重试失败 | 超过最大重试 | 进 DLX,人工处理 |
对账不一致 | 漏消息/脏消息 | 离线补平或冲正 |
8. 性能 & 运维要点
- 事件表 按月分区,保留 90 天自动过期;
- 补偿任务单机即可,限流 200 TPS 防止打爆 MQ;
- 生产端开启 batch-send 可提升 3 倍吞吐;
- 所有队列 镜像模式 ≥2 节点,磁盘持久化;
- 监控看板:UNSENT 积压量、DLX 增长率、confirm 失效率。
9. 一句话总结
RabbitMQ 没有"回滚"按钮,只有"补发 + 补偿 + 对账"三板斧;
把本地消息表、confirm、幂等、补偿、对账 5 步全部落地,即可在纯 RabbitMQ 环境下实现生产级分布式事务。
下面给出一份可直接复制到 IDE 跑通 的「RabbitMQ 最终一致性」完整 Demo,所有配置、SQL、Java 代码、MQ 声明全部贴全。
Spring Boot 3.2 + RabbitMQ 3.12。
- 工程骨架(Maven 依赖)
xml
<parent>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-parent</artifactId>
<version>3.2.5</version>
</parent>
<properties>
<java.version>17</java.version>
</properties>
<dependencies>
<!-- web -->
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
<!-- rabbit -->
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-amqp</artifactId>
</dependency>
<!-- mysql -->
<dependency>
<groupId>com.mysql</groupId>
<artifactId>mysql-connector-j</artifactId>
<scope>runtime</scope>
</dependency>
<!-- mybatis-plus -->
<dependency>
<groupId>com.baomidou</groupId>
<artifactId>mybatis-plus-boot-starter</artifactId>
<version>3.5.5</version>
</dependency>
<!-- lombok -->
<dependency>
<groupId>org.projectlombok</groupId>
<artifactId>lombok</artifactId>
<optional>true</optional>
</dependency>
</dependencies>
- application.yml(全部配置)
yaml
server:
port: 8080
spring:
datasource:
driver-class-name: com.mysql.cj.jdbc.Driver
url: jdbc:mysql://127.0.0.1:3306/shop?useSSL=false&serverTimezone=Asia/Shanghai
username: root
password: 123456
rabbitmq:
host: 127.0.0.1
port: 5672
username: guest
password: guest
virtual-host: /
publisher-confirm-type: correlated # 开启 publisher confirm
publisher-returns: true # 消息不可达会触发 return
template:
mandatory: true # 配合 returns 使用
listener:
type: simple
simple:
acknowledge-mode: manual # 手工 ack
prefetch: 5 # 限流
default-requeue-rejected: false # 业务异常不重新入队,直接 DLX
mybatis-plus:
configuration:
log-impl: org.apache.ibatis.logging.stdout.StdOutImpl
mapper-locations: classpath*:/mapper/**/*.xml
- MySQL 表 SQL(一次性执行)
sql
CREATE DATABASE IF NOT EXISTS shop DEFAULT CHARACTER SET utf8mb4;
USE shop;
-- 订单表
CREATE TABLE t_order (
id BIGINT PRIMARY KEY AUTO_INCREMENT,
user_id BIGINT NOT NULL,
sku_id BIGINT NOT NULL,
quantity INT NOT NULL,
amount DECIMAL(10,2) NOT NULL,
status VARCHAR(32) NOT NULL DEFAULT 'INIT',
create_time DATETIME DEFAULT CURRENT_TIMESTAMP
);
-- 本地事件表
CREATE TABLE t_local_event (
id BIGINT PRIMARY KEY AUTO_INCREMENT,
biz_id VARCHAR(64) NOT NULL,
event_type VARCHAR(64) NOT NULL,
payload TEXT NOT NULL,
status VARCHAR(32) NOT NULL DEFAULT 'UNSENT',
create_time DATETIME DEFAULT CURRENT_TIMESTAMP,
update_time DATETIME DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
INDEX idx_bizid_type (biz_id, event_type),
INDEX idx_status (status)
) ENGINE=InnoDB;
-- 库存表(为了演示简单)
CREATE TABLE t_stock (
id BIGINT PRIMARY KEY AUTO_INCREMENT,
sku_id BIGINT NOT NULL UNIQUE,
available INT NOT NULL
);
-- 扣库存流水(幂等)
CREATE TABLE t_stock_flow (
id BIGINT PRIMARY KEY AUTO_INCREMENT,
order_id VARCHAR(64) NOT NULL UNIQUE,
sku_id BIGINT NOT NULL,
quantity INT NOT NULL,
status VARCHAR(32) NOT NULL,
create_time DATETIME DEFAULT CURRENT_TIMESTAMP
);
- RabbitMQ 配置类(声明队列、交换机、DLX)
java
@Configuration
public class RabbitConfig {
/* ---------------- 业务队列 ---------------- */
public static final String STOCK_REDUCE_QUEUE = "stock.reduce.queue";
public static final String STOCK_EXCHANGE = "stock.topic";
public static final String STOCK_RK = "stock.reduce";
/* ---------------- 补偿队列 ---------------- */
public static final String COMPENSATE_QUEUE = "order.compensate.queue";
public static final String COMPENSATE_EX = "compensate.topic";
public static final String COMPENSATE_RK = "order.cancel";
/* ---------------- 死信参数 ---------------- */
private static final String DLX_NAME = "dlx.topic";
private static final String DLQ_NAME = "stock.reduce.dlq";
@Bean
TopicTopicExchange stockExchange() {
return ExchangeBuilder.topicExchange(STOCK_EXCHANGE).durable(true).build();
}
@Bean
TopicTopicExchange dlxExchange() {
return ExchangeBuilder.topicExchange(DLX_NAME).durable(true).build();
}
@Bean
public Queue stockReduceQueue() {
return QueueBuilder.durable(STOCK_REDUCE_QUEUE)
.withArgument("x-dead-letter-exchange", DLX_NAME)
.withArgument("x-dead-letter-routing-key", DLQ_NAME)
.build();
}
@Bean
public Binding stockBinding() {
return BindingBuilder
.bind(stockReduceQueue())
.to(stockExchange())
.with(STOCK_RK);
}
@Bean
public Queue dlq() {
return QueueBuilder.durable(DLQ_NAME).build();
}
@Bean
public Binding dlqBinding() {
return BindingBuilder.bind(dlq()).to(dlxExchange()).with(DLQ_NAME);
}
/* 补偿交换机队列 */
@Bean
public TopicExchange compensateEx() {
return ExchangeBuilder.topicExchange(COMPENSATE_EX).durable(true).build();
}
@Bean
public Queue compensateQueue() {
return QueueBuilder.durable(COMPENSATE_QUEUE).build();
}
@Bean
public Binding compensateBinding() {
return BindingBuilder.bind(compensateQueue()).to(compensateEx()).with(COMPENSATE_RK);
}
}
- 实体 & Mapper(MyBatis-Plus)
java
@Data
@TableName("t_order")
public class Order {
private Long id;
private Long userId;
private Long skuId;
private Integer quantity;
private BigDecimal amount;
private String status;
private LocalDateTime createTime;
}
@Data
@TableName("t_local_event")
public class LocalEvent {
private Long id;
private String bizId;
private String eventType;
private String payload;
private String status;
private LocalDateTime createTime;
private LocalDateTime updateTime;
}
@Mapper
public interface OrderMapper extends BaseMapper<Order> {}
@Mapper
public interface LocalEventMapper extends BaseMapper<LocalEvent> {}
- 事务消息发送工具(confirm + 本地事件)
java
@Component
@RequiredArgsConstructor
public class EventPublisher {
private final RabbitTemplate rabbitTemplate;
private final LocalEventMapper eventMapper;
@PostConstruct
public void init() {
rabbitTemplate.setConfirmCallback((correlationData, ack, cause) -> {
if (ack) {
eventMapper.updateStatus(correlationData.getId(), "SENT");
} else {
// 不处理,等定时任务
}
});
}
/**
* 事务内仅落库;AFTER_COMMIT 再调本方法
*/
public void publish(String bizId, String eventType, Object payload) {
LocalEvent event = new LocalEvent();
event.setBizId(bizId);
event.setEventType(eventType);
event.setPayload(JSON.toJSONString(payload));
event.setStatus("UNSENT");
eventMapper.insert(event);
CorrelationData cd = new CorrelationData(event.getId().toString());
rabbitTemplate.convertAndSend(
RabbitConfig.STOCK_EXCHANGE,
RabbitConfig.STOCK_RK,
event.getPayload(),
cd);
}
}
- 订单服务(本地事务 + 事件)
java
@Service
@RequiredArgsConstructor
public class OrderService {
private final OrderMapper orderMapper;
private final EventPublisher publisher;
private final ApplicationEventPublisher appEventPublisher;
@Transactional
public String createOrder(Long userId, Long skuId, Integer quantity) {
// 1. 落单
Order order = new Order();
order.setUserId(userId);
order.setSkuId(skuId);
order.setQuantity(quantity);
order.setAmount(BigDecimal.valueOf(quantity * 100)); // 单价 100
order.setStatus("INIT");
orderMapper.insert(order);
// 2. 写事件表(同一事务)
publisher.publish(order.getId().toString(), "ORDER_CREATED",
Map.of("orderId", order.getId(),
"skuId", skuId,
"quantity", quantity));
return order.getId().toString();
}
}
- 库存服务(幂等 + 业务失败补偿)
java
@Component
@RequiredArgsConstructor
public class StockConsumer {
private final StockFlowMapper flowMapper;
private final RabbitTemplate rabbitTemplate;
@RabbitListener(queues = RabbitConfig.STOCK_REDUCE_QUEUE)
public void reduce(Message msg, Channel channel,
@Header(AmqpHeaders.DELIVERY_TAG) long tag) throws IOException {
try {
String body = new String(msg.getBody());
JSONObject json = JSON.parseObject(body);
String orderId = json.getString("orderId");
Long skuId = json.getLong("skuId");
Integer quantity = json.getInteger("quantity");
// 1. 幂等
if (flowMapper.exists(orderId)) {
channel.basicAck(tag, false);
return;
}
// 2. 业务校验
Integer available = flowMapper.availableOf(skuId);
if (available < quantity) {
// 库存不足 -> 补偿
sendCompensate(orderId, "STOCK_NOT_ENOUGH");
channel.basicAck(tag, false); // 必须 ack
return;
}
// 3. 扣减
flowMapper.deduct(skuId, quantity);
flowMapper.insert(orderId, skuId, quantity, "SUCCESS");
channel.basicAck(tag, false);
} catch (Exception e) {
log.error("扣库存异常", e);
channel.basicNack(tag, false, true); // 重试
}
}
private void sendCompensate(String orderId, String reason) {
Map<String, String> cmd = Map.of("orderId", orderId, "reason", reason);
rabbitTemplate.convertAndSend(RabbitConfig.COMPENSATE_EX,
RabbitConfig.COMPENSATE_RK,
JSON.toJSONString(cmd));
}
}
- 补偿消费者(关闭订单 + 退款)
java
@Component
@RequiredArgsConstructor
public class CompensateConsumer {
private final OrderMapper orderMapper;
@RabbitListener(queues = RabbitConfig.COMPENSATE_QUEUE)
public void compensate(String json) {
JSONObject cmd = JSON.parseObject(json);
String orderId = cmd.getString("orderId");
Order order = orderMapper.selectById(orderId);
if (order == null || "CLOSED".equals(order.getStatus())) return;
// 1. 关单
order.setStatus("CLOSED");
orderMapper.updateById(order);
// 2. 退款(demo 直接日志)
log.warn(">>>> 退款操作 orderId={}, amount={}", orderId, order.getAmount());
// 3. 释放库存由 stock 服务监听同一条 cmd 自行加回
}
}
- 定时补偿任务(扫 UNSENT)
java
@Component
@RequiredArgsConstructor
public class ResendScheduler {
private final LocalEventMapper eventMapper;
private final RabbitTemplate rabbitTemplate;
// 每 5 秒扫一次
@Scheduled(fixedDelay = 5000)
public void resend() {
List<LocalEvent> list = eventMapper.selectList(
new QueryWrapper<LocalEvent>().eq("status", "UNSENT")
.le("create_time", LocalDateTime.now().minusSeconds(10))); // 兜底延迟
for (LocalEvent e : list) {
CorrelationData cd = new CorrelationData(e.getId().toString());
rabbitTemplate.convertAndSend(
RabbitConfig.STOCK_EXCHANGE,
RabbitConfig.STOCK_RK,
e.getPayload(),
cd);
}
}
}
- 启动类
java
@SpringBootApplication
@EnableScheduling
@MapperScan("com.example.mapper")
public class TxApplication {
public static void main(String[] args) {
SpringApplication.run(TxApplication.class, args);
}
}
-
快速自测
-
启动 RabbitMQ、MySQL,执行上方 SQL
-
curl -X POST http://localhost:8080/order?userId=1&skuId=10&quantity=2
-
观察控制台:
- 订单落库 → 事件 UNSENT → 消息发送 → 收到 confirm → 事件变 SENT → 库存扣减成功
- 把库存改成 1 再下单,日志出现
>>>> 退款操作
,订单状态变为 CLOSED,即补偿成功。
- 小结
这份代码直接把前面所有本地消息表、confirm、幂等、补偿、对账落地:
- 零消息丢失:confirm + 定时重扫 UNSENT
- 幂等:t_stock_flow.order_id 唯一索引
- 业务失败:立即发补偿消息,关单+退款
- 技术异常:basicNack 重投 → 进 DLX → 人工