spring-ai 1.0.0 (3)交互增强:Advisor 顾问模块

核心组件

API 由非流式处理方案和 和 流式处理方案组成。

在1.0.0版本中,顾问链AdvisorChain相关接口已经弃用,可能是老版本的思想不太合伦理吧

可以使用下面的方式实现多个顾问按oder顺序访问模型

复制代码
    public ChatController(ChatClient.Builder chatClientBuilder) {
        MySimpleLoggerAdvisor advisor3=  new MySimpleLoggerAdvisor(3);
        MySimpleLoggerAdvisor advisor2= new MySimpleLoggerAdvisor(2);
        MySimpleLoggerAdvisor advisor1= new MySimpleLoggerAdvisor(1);
        this.chatClient = chatClientBuilder
                //此处执行顺序由order决定,并非添加顺序决定
                .defaultAdvisors(List.of(
                        advisor3,
                        advisor2,
                        advisor1)
                )
                .defaultSystem("You are a helpful assistant")
                .build();
    }

下图说明了顾问链和聊天模型之间的交互:

顾问advice之间的request和response 基于order 对称,比如三个女孩子按顺序123追你,你给出的答复顺序则应该是321

交互返回:

Spring AI 提供了两种类型的内存顾问程序来维护对话上下文:

顾问 存储机制 模板占位符
PromptChatMemoryAdvisor 内存中或自定义 instructions,memory
VectorStoreChatMemoryAdvisor 向量数据库 instructions,long_term_memory

下面是一个简单顾问的实现用于参考学习:

复制代码
package com.example.advisor;


import org.springframework.ai.chat.client.ChatClientRequest;
import org.springframework.ai.chat.client.ChatClientResponse;
import org.springframework.ai.chat.client.advisor.api.CallAdvisor;
import org.springframework.ai.chat.client.advisor.api.CallAdvisorChain;
import org.springframework.ai.chat.client.advisor.api.StreamAdvisor;
import org.springframework.ai.chat.client.advisor.api.StreamAdvisorChain;
import reactor.core.publisher.Flux;


public class MySimpleLoggerAdvisor implements CallAdvisor, StreamAdvisor {


    private Integer order;
    public MySimpleLoggerAdvisor() {
        super();
    }

    public MySimpleLoggerAdvisor(Integer preOrder) {
        order = preOrder;
    }


    public ChatClientResponse adviseCall(ChatClientRequest chatClientRequest, CallAdvisorChain callAdvisorChain) {
        System.out.println("BEFORE: {}" + chatClientRequest);
        System.out.println("do something order  " + this.order);

        ChatClientResponse chatClientResponse = callAdvisorChain.nextCall(chatClientRequest);

        System.out.println("AFTER: {}" + chatClientResponse);

        System.out.println("was do something order  " + this.order);
        return chatClientResponse;
    }

    @Override
    public String getName() {
        return "MySimpleLoggerAdvisor";
    }

    @Override
    public int getOrder() {
        return this.order == null ? 0 : this.order;
    }


//	@Override
//	public AdvisedResponse aroundCall(AdvisedRequest advisedRequest, CallAroundAdvisorChain chain) {
//
//		logger.debug("BEFORE: {}", advisedRequest);
//
//		AdvisedResponse advisedResponse = chain.nextAroundCall(advisedRequest);
//
//		logger.debug("AFTER: {}", advisedResponse);
//
//		return advisedResponse;
//	}
//

    @Override
    public Flux<ChatClientResponse> adviseStream(ChatClientRequest chatClientRequest, StreamAdvisorChain streamAdvisorChain) {
        System.out.println("BEFORE: {}" + chatClientRequest);
        System.out.println("do something");

        Flux<ChatClientResponse> chatClientResponse = streamAdvisorChain.nextStream(chatClientRequest);

        System.out.println("AFTER: {}" + chatClientResponse);

        System.out.println("was do something");

        return chatClientResponse;
    }

//	@Override
//	public Flux<AdvisedResponse> aroundStream(AdvisedRequest advisedRequest, StreamAroundAdvisorChain chain) {
//
//		logger.debug("BEFORE: {}", advisedRequest);
//
//		Flux<AdvisedResponse> advisedResponses = chain.nextAroundStream(advisedRequest);
//
//        return new MessageAggregator().aggregateAdvisedResponse(advisedResponses,
//                    advisedResponse -> logger.debug("AFTER: {}", advisedResponse));
//	}
}

最后分析一下顾问模块的依赖关系:chatclient客户端是依赖于它的,他和chatclient客户端也同时依赖于spring-ai-模型,Core Advisor 框架在spring-ai-模型中得到定义和泛化

相关推荐
寻星探路10 小时前
【深度长文】万字攻克网络原理:从 HTTP 报文解构到 HTTPS 终极加密逻辑
java·开发语言·网络·python·http·ai·https
曹牧13 小时前
Spring Boot:如何测试Java Controller中的POST请求?
java·开发语言
爬山算法13 小时前
Hibernate(90)如何在故障注入测试中使用Hibernate?
java·后端·hibernate
kfyty72514 小时前
集成 spring-ai 2.x 实践中遇到的一些问题及解决方案
java·人工智能·spring-ai
猫头虎14 小时前
如何排查并解决项目启动时报错Error encountered while processing: java.io.IOException: closed 的问题
java·开发语言·jvm·spring boot·python·开源·maven
李少兄14 小时前
在 IntelliJ IDEA 中修改 Git 远程仓库地址
java·git·intellij-idea
忆~遂愿14 小时前
ops-cv 算子库深度解析:面向视觉任务的硬件优化与数据布局(NCHW/NHWC)策略
java·大数据·linux·人工智能
小韩学长yyds14 小时前
Java序列化避坑指南:明确这4种场景,再也不盲目实现Serializable
java·序列化
仟濹14 小时前
【Java基础】多态 | 打卡day2
java·开发语言