记录一次死锁检测

  1. 现象是这样的,服务有时启动正常,有时启动失败,最后排查发现是mq消费者造成的。 启动dubbo过程中,mq消费者正常消费,调用某个dubbo服务。此时dubbo application正处于starting状态,造成了死锁。

2.模拟死锁过程,获取到的线程信息,已省略无关的信息。

java 复制代码
Found one Java-level deadlock:
=============================
"Thread-2":
  waiting to lock monitor 0x00000136bfd3bb88 (object 0x00000005c4c594f0, a org.apache.dubbo.config.deploy.DefaultModuleDeployer),
  which is held by "main"
"main":
  waiting to lock monitor 0x00000136ba6465d8 (object 0x00000005c46287e0, a java.util.concurrent.ConcurrentHashMap),
  which is held by "Thread-2"

Java stack information for the threads listed above:
===================================================
"Thread-2":
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.startSync(DefaultModuleDeployer.java:143)
        - waiting to lock <0x00000005c4c594f0> (a org.apache.dubbo.config.deploy.DefaultModuleDeployer)
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.start(DefaultModuleDeployer.java:139)
        at org.apache.dubbo.config.ReferenceConfig.get(ReferenceConfig.java:228)
        at org.apache.dubbo.config.spring.ReferenceBean.getCallProxy(ReferenceBean.java:351)
        - locked <0x00000005c46287e0> (a java.util.concurrent.ConcurrentHashMap)
        at org.apache.dubbo.config.spring.ReferenceBean.access$100(ReferenceBean.java:100)
        at org.apache.dubbo.config.spring.ReferenceBean$DubboReferenceLazyInitTargetSource.createObject(ReferenceBean.java:359)
        at org.springframework.aop.target.AbstractLazyCreationTargetSource.getTarget(AbstractLazyCreationTargetSource.java:86)
        - locked <0x00000005c98d68d0> (a org.apache.dubbo.config.spring.ReferenceBean$DubboReferenceLazyInitTargetSource)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:192)
        ....
"main":
        at org.springframework.context.event.AbstractApplicationEventMulticaster.getApplicationListeners(AbstractApplicationEventMulticaster.java:187)
        - waiting to lock <0x00000005c46287e0> (a java.util.concurrent.ConcurrentHashMap)
        at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:128)
        at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:393)
        at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:347)
        at org.apache.dubbo.config.spring.ServiceBean.publishExportEvent(ServiceBean.java:133)
        at org.apache.dubbo.config.spring.ServiceBean.exported(ServiceBean.java:125)
        at org.apache.dubbo.config.ServiceConfig.doExport(ServiceConfig.java:392)
        - locked <0x00000005c9398570> (a org.apache.dubbo.config.spring.ServiceBean)
        at org.apache.dubbo.config.ServiceConfig.export(ServiceConfig.java:243)
        - locked <0x00000005c9398570> (a org.apache.dubbo.config.spring.ServiceBean)
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.exportServiceInternal(DefaultModuleDeployer.java:350)
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.exportServices(DefaultModuleDeployer.java:322)
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.startSync(DefaultModuleDeployer.java:158)
        - locked <0x00000005c4c594f0> (a org.apache.dubbo.config.deploy.DefaultModuleDeployer)
        at org.apache.dubbo.config.deploy.DefaultModuleDeployer.start(DefaultModuleDeployer.java:139)
        at org.apache.dubbo.config.spring.context.DubboDeployApplicationListener.onContextRefreshedEvent(DubboDeployApplicationListener.java:113)
        at org.apache.dubbo.config.spring.context.DubboDeployApplicationListener.onApplicationEvent(DubboDeployApplicationListener.java:102)
        at org.apache.dubbo.config.spring.context.DubboDeployApplicationListener.onApplicationEvent(DubboDeployApplicationListener.java:47)
		...

Found 1 deadlock.
  1. 解决方案
java 复制代码
    @EventListener
    public void onDubboStarted(DubboApplicationStateEvent event) {
        if (event.getState() == DeployState.STARTED) {
            doSomething();
        }
    }
相关推荐
Suxing922 分钟前
C语言基础分享:从“租房”到“拆迁”,C语言动态内存管理
java·数据结构·算法
减瓦23 分钟前
别让 Java 版本选择变成生产事故
java
ikun_文23 分钟前
Java集合框架Collection拓展进阶
java·java ee
码匠许师傅37 分钟前
【C++ 面试真题】聊聊 C++ 的虚函数和多态
java·c++·面试
chuan.bai1 小时前
Java RAG 实战(第 8 篇):Spring Boot RAG 查询 API
java·spring boot·贪心算法
FlyWIHTSKY1 小时前
idea中集成claude功能
java·ide·人工智能·intellij-idea·cloudera
Java成神之路-1 小时前
Spring AI 统一结构化返回:ChatModel / ChatClient 两种实现方式
java·springaialibaba
Mr. zhihao1 小时前
深度解析:为什么Java序列化需要搭配ByteArrayOutputStream?IO装饰器模式的精妙设计
java·开发语言·装饰器模式
存在morning1 小时前
【Python 开发实践 一】Python vs Go vs Java 三门语言对比
java·python·golang
vx-程序开发1 小时前
springboot旅游推介平台---附源码24175
java·spring boot·python·spring cloud·eclipse·django·idea