Spring boot集成milvus(spring ai)

服务器部署Milvus

Run Milvus with Docker Compose (Linux)

milvus版本可在docker-compose.yml中进行image修改

启动后,docker查看启动成功

spring boot集成milvus

参考了这篇文章
Spring AI开发RAG示例,理解RAG执行原理

但集成过程中遇到了一系列问题,所以想着记录一下,省的以后再次集成遇到同样的问题看这一篇文章就行了

问题1 启动时报错,错误信息为 INTERNAL: Failed to frame message和This is supposed to be overridden by subclasses.

java 复制代码
io.grpc.StatusRuntimeException: INTERNAL: Failed to frame message
	at io.grpc.Status.asRuntimeException(Status.java:529) ~[grpc-api-1.59.1.jar:1.59.1]
	at io.grpc.internal.MessageFramer.writePayload(MessageFramer.java:154) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.AbstractStream.writeMessage(AbstractStream.java:66) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.ForwardingClientStream.writeMessage(ForwardingClientStream.java:37) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.DelayedStream$6.run(DelayedStream.java:283) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.DelayedStream.drainPendingCalls(DelayedStream.java:182) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.DelayedStream.access$100(DelayedStream.java:44) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.DelayedStream$4.run(DelayedStream.java:148) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.stub.ClientCalls$ThreadlessExecutor.runQuietly(ClientCalls.java:742) ~[grpc-stub-1.59.1.jar:1.59.1]
	at io.grpc.stub.ClientCalls$ThreadlessExecutor.waitAndDrain(ClientCalls.java:725) ~[grpc-stub-1.59.1.jar:1.59.1]
	at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:159) ~[grpc-stub-1.59.1.jar:1.59.1]
	at io.milvus.grpc.MilvusServiceGrpc$MilvusServiceBlockingStub.hasCollection(MilvusServiceGrpc.java:3992) ~[milvus-sdk-java-2.3.5.jar:na]
	at io.milvus.client.AbstractMilvusGrpcClient.hasCollection(AbstractMilvusGrpcClient.java:372) ~[milvus-sdk-java-2.3.5.jar:na]
	at io.milvus.client.MilvusServiceClient.lambda$hasCollection$1(MilvusServiceClient.java:358) ~[milvus-sdk-java-2.3.5.jar:na]
	at io.milvus.client.MilvusServiceClient.retry(MilvusServiceClient.java:277) ~[milvus-sdk-java-2.3.5.jar:na]
	at io.milvus.client.MilvusServiceClient.hasCollection(MilvusServiceClient.java:358) ~[milvus-sdk-java-2.3.5.jar:na]
	at org.springframework.ai.vectorstore.milvus.MilvusVectorStore.isDatabaseCollectionExists(MilvusVectorStore.java:423) ~[spring-ai-milvus-store-1.0.0-M5.jar:1.0.0-M5]
	at org.springframework.ai.vectorstore.milvus.MilvusVectorStore.createCollection(MilvusVectorStore.java:433) ~[spring-ai-milvus-store-1.0.0-M5.jar:1.0.0-M5]
	at org.springframework.ai.vectorstore.milvus.MilvusVectorStore.afterPropertiesSet(MilvusVectorStore.java:411) ~[spring-ai-milvus-store-1.0.0-M5.jar:1.0.0-M5]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1853) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1802) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:600) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:254) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1443) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1353) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:785) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:768) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:145) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:509) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1439) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:599) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:975) ~[spring-beans-6.1.12.jar:6.1.12]
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:971) ~[spring-context-6.1.12.jar:6.1.12]
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:625) ~[spring-context-6.1.12.jar:6.1.12]
	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:146) ~[spring-boot-3.3.3.jar:3.3.3]
	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:754) ~[spring-boot-3.3.3.jar:3.3.3]
	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:456) ~[spring-boot-3.3.3.jar:3.3.3]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:335) ~[spring-boot-3.3.3.jar:3.3.3]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1363) ~[spring-boot-3.3.3.jar:3.3.3]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1352) ~[spring-boot-3.3.3.jar:3.3.3]
	at com.betp.milvus.BetpMilvusApplication.main(BetpMilvusApplication.java:16) ~[classes/:na]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:na]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[na:na]
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
	at java.base/java.lang.reflect.Method.invoke(Method.java:568) ~[na:na]
	at org.springframework.boot.devtools.restart.RestartLauncher.run(RestartLauncher.java:50) ~[spring-boot-devtools-3.3.3.jar:3.3.3]
Caused by: java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
	at com.google.protobuf.GeneratedMessageV3.getUnknownFields(GeneratedMessageV3.java:302) ~[protobuf-java-3.19.4.jar:na]
	at io.milvus.grpc.HasCollectionRequest.getSerializedSize(HasCollectionRequest.java:237) ~[milvus-sdk-java-2.3.5.jar:na]
	at io.grpc.protobuf.lite.ProtoInputStream.available(ProtoInputStream.java:108) ~[grpc-protobuf-lite-1.59.1.jar:1.59.1]
	at io.grpc.internal.MessageFramer.getKnownLength(MessageFramer.java:208) ~[grpc-core-1.59.1.jar:1.59.1]
	at io.grpc.internal.MessageFramer.writePayload(MessageFramer.java:138) ~[grpc-core-1.59.1.jar:1.59.1]
	... 54 common frames omitted

问题1解答

实际问题为(spring-ai-milvus-store)中(milvus-sdk-java)中的(protobuf-java)的版本问题

(protobuf-java)版本修改逻辑为图中的版本3.24.0

修改后的代码为

java 复制代码
        <dependency>
            <groupId>org.springframework.ai</groupId>
            <artifactId>spring-ai-milvus-store</artifactId>
            <version>${spring-ai.version}</version>
            <exclusions>
                <exclusion>
                    <groupId>com.google.protobuf</groupId>
                    <artifactId>protobuf-java</artifactId>
                </exclusion>
            </exclusions>
        </dependency>
        <dependency>
            <groupId>com.google.protobuf</groupId>
            <artifactId>protobuf-java</artifactId>
            <version>3.24.0</version>
            <scope>compile</scope>
        </dependency>

问题2 spring-ai-milvus-store和服务器milvus版本兼容问题

官网版本兼容截图

问题2解答

服务器milvus版本为v2.5.4,按图所说对应sdk版本应为2.5.9,但实际操作时会报错,经过尝试(不断修改spring-ai.version版本)后,适用的(milvus-sdk-java)版本为2.3.5

当前仅发现这几个问题,以后发现集成中的问题会继续添加

相关推荐
Oliver_LaVine21 小时前
java后端实现全链路日志ID记录
java·开发语言·spring
VX:Fegn089521 小时前
计算机毕业设计|基于springboot + vue电影院购票管理系统(源码+数据库+文档)
数据库·vue.js·spring boot·后端·课程设计
ZePingPingZe21 小时前
MySQL与Spring,事务与自动提交有什么关系?
mysql·spring
running up21 小时前
Spring IOC/DI 核心知识
java·spring·rpc
q_191328469521 小时前
基于SpringBoot2+Vue2的企业合作与活动管理平台
java·vue.js·经验分享·spring boot·笔记·mysql·计算机毕业设计
学网安的肆伍21 小时前
【040-安全开发篇】JavaEE应用&SpringBoot框架&JWT身份鉴权&打包部署JAR&WAR
spring boot·安全·java-ee
Han.miracle21 小时前
Spring WebMVC入门实战:从概念到连接建立全解析
java·spring boot·spring·springmvc
TT哇21 小时前
Spring Boot 项目中关于文件上传与访问的配置方案
java·spring boot·后端
韩立学长1 天前
Springboot考研自习室预约管理系统1wdeuxh6(程序、源码、数据库、调试部署方案及开发环境)系统界面展示及获取方式置于文档末尾,可供参考。
数据库·spring boot·后端
残花月伴1 天前
天机学堂-day5(互动问答)
java·spring boot·后端