ALA: Cognitive Architectures for Language Agents,CoALA:面向语言智能体的认知架构
Sumers et al. 344 propose Cognitive Architectures for Language Agents (CoALA), a unifying framework that organizes the growing zoo of LLM agents using principles from cognitive science and symbolic AI.
Sumers 等人提出了 CoALA(Cognitive Architectures for Language Agents),一套统一框架。它借鉴认知科学与符号人工智能原理,对目前五花八门的大模型智能体方案进行归类梳理。
CoALA decomposes a language agent into CoALA 将语言智能体拆解为三大部分:
• Modular memory: working memory (the context window), episodic memory (past experiences), semantic memory (world knowledge), and procedural memory (action schemas)---mirroring our taxonomy in Section 17.2.
模块化记忆:工作记忆(上下文窗口)、情景记忆(过往经历)、语义记忆(世界常识知识)、程序记忆(行动范式),和本书 17.2 小节里的记忆分类完全对应
• Structured action space: internal actions (reasoning, retrieval, memory writes) and external actions (tool use, environment interaction).
结构化动作空间:内部动作(推理、记忆检索、写入记忆)、外部动作(调用工具、和外部环境交互)
• Decision cycle: a generalized sense--plan--act loop with explicit retrieval and write steps.
决策循环:通用的「感知‑规划‑执行」闭环,并且显式加入记忆检索、记忆写入步骤
CoALA's contribution is less a new system than a design language: it provides a systematic way to analyze existing agents and identify missing capabilities, making it a useful reference architecture for practitioners.
CoALA 的核心贡献并不是开发了一套全新智能体系统,而是提供了一套设计描述语言。开发者可以用它系统性地剖析现有 Agent,找出能力短板;非常适合工程人员当作参考架构
Mem0: Production‑Scale Memory Layer,Mem0:面向生产环境的记忆中间层
Mem0 53 addresses the gap between research memory systems and production deployment. Key ideas:
Mem0 瞄准学术原型记忆系统和线上落地之间的差距。核心思路如下:
• Automatic extraction: Rather than relying on the LLM to explicitly issue memory‑write commands, Mem0 automatically extracts salient facts from conversation turns and consolidates them into a persistent store.
自动提取记忆:不需要大模型显式发送 "写入记忆" 指令;Mem0 自动从对话中提取关键事实,并整合存入持久化存储。
• Graph‑based memory: Beyond flat vector stores, Mem0 maintains a relational graph over extracted entities and facts, enabling multi‑hop memory queries ("What did the user say about topic X in the context of project Y?").
基于图结构的记忆:不再是简单扁平向量库(flat vector stores);它为抽取出来的实体、事实维护一张关系图谱,支持多跳记忆检索(例如查询:在项目 Y 背景下,用户关于主题 X 都说过哪些内容?)
• Memory compression: Redundant or superseded facts are automatically merged, keeping the memory store compact and current.
记忆压缩:自动合并冗余信息、已经过时的事实,保证记忆库精简,并且存储最新状态。
On the LOCOMO benchmark, Mem0 achieves 26% relative improvement over OpenAI's baseline memory, with 91% lower p95 latency and >90% token cost reduction compared to full‑context approaches.
在 LOCOMO 评测集上,Mem0 相比 OpenAI 基线记忆方案,相对性能提升 26%;p95 延迟降低 91%;对比把全部历史塞进上下文的方案,Token 开销降低 90% 以上
Sleep‑Time Compute: Offline Memory Processing 休眠期计算:离线记忆加工
anticipate ænˈtɪsɪpeɪt v. 预期,预料;预见(并做准备);期望,盼望;先于......做,早于......行动;提前使用
artifacts 'a:rtifækts n. 史前古器物;人工产品
amortized əˈmɔːtaɪzd
adj. 分期偿还;已摊销的;已分期偿还的
n. 摊销额
vt. 摊销(amortize的过去分词);分期偿还;把...转让
Lin et al. 218 introduce sleep‑time compute, a paradigm where agents process and consolidate memory between user interactions rather than only at query time. The analogy is to biological sleep, during which the brain consolidates memories and pre‑computes useful associations.
Lin 等人提出休眠期计算(Sleep‑Time Compute)范式:智能体不在用户提问那一刻才处理记忆;而是在两次用户交互的空闲间隙,完成记忆加工与巩固。灵感来自人脑睡眠过程:大脑趁休息巩固记忆,预先构建事物之间的关联
How it works. During idle periods ("sleep"), the agent:
工作流程:在空闲(休眠)时段,智能体执行三步:
Anticipates likely future queries given the current context.
根据当前上下文预判用户之后大概率会提出哪些问题
Pre‑computes reasoning chains, summaries, and structured representations.
预先计算推理链路、内容摘要、结构化记忆表示
Stores these pre‑computed artifacts so that test‑time inference can retrieve and reuse them.
将预计算结果保存下来;等到线上推理(test‑time inference)时直接检索复用,省去重复计算
Results. Sleep‑time compute reduces the test‑time compute needed to achieve equivalent accuracy by ∼5× on reasoning benchmarks. When amortized across multiple related queries about the same context, average cost per query drops by 2.5×. The approach is most effective when user queries are predictable---i.e., when the context strongly constrains what questions will be asked.
实验结果:在推理任务上,休眠计算能够把达到同等精度所需的线上算力降低约 5 倍;当同一个上下文产生多条相关提问时,分摊后单条查询平均成本下降 2.5 倍。该方案最适合用户问题可预测的场景:上下文本身就限定了后续提问范围
Memory Consolidation as Offline RL 将记忆巩固看作离线强化学习
Sleep‑time compute can be viewed as offline policy improvement: during idle time, the agent improves its memory representations (policy) using the data it has already collected (past interactions), without new environment interactions. This connects to offline RL methods (Chapter 8) where the agent learns from a static dataset of trajectories.
休眠期计算可以理解成离线策略优化:空闲阶段智能体仅利用已经收集好的历史交互数据优化记忆表示(记忆策略),不需要再和环境产生新交互。这和离线强化学习思路相通:智能体从一份固定不变的轨迹数据集当中学习。
A‑MEM: Zettelkasten‑Inspired Agentic Memory
A‑MEM:受卡片盒笔记法启发的智能体记忆系统
A‑MEM 400 introduces a memory system that borrows from the Zettelkasten method---a note‑taking system based on densely interconnected atomic notes---to enable dynamic, self‑organizing memory for LLM agents.
A‑MEM 借鉴卡片盒笔记法 (Zettelkasten)设计记忆系统。卡片盒笔记法核心是大量互相链接的原子笔记;A‑MEM 以此实现大模型智能体动态、自组织的记忆能力。
Key Design Principles.
核心设计原则
• Structured notes. Each memory entry is not a raw text chunk but a note with multiple structured attributes: a contextual description, keywords, tags, and explicit links to related notes. This metadata enables richer retrieval than embedding similarity alone.
结构化笔记:每一条记忆不再是原始文本片段;而是一条带有丰富属性的笔记:上下文描述、关键词、标签、指向其他笔记的显式链接。依托元数据,可以实现比单纯向量相似度更精准的检索。
• Dynamic linking. When a new memory is added, the system analyzes existing memories to identify semantically meaningful connections and establishes bidirectional links. The result is a knowledge network rather than a flat list.
动态建链:新增一条记忆时,系统扫描已有记忆,找出语义关联并创建双向链接;最终记忆库形成一张知识网络,而不是扁平无关联的列表。
• Memory evolution. Critically, adding a new note can trigger updates to existing notes---refining their contextual representations and attributes as the agent's understanding deepens. This makes memory a living structure that improves over time, not a static archive.
记忆演化更新:最关键一点:新增笔记会触发对旧笔记的修改;随着智能体认知加深,旧记忆的上下文描述、属性会被优化迭代。记忆不再是一成不变的存档,而是可以持续生长进化的活体结构。
• Agent‑driven organization. Unlike fixed‑schema memory systems, A‑MEM lets the LLM itself decide how to organize, link, and update memories---making the organizational structure adaptive to the task domain.
智能体自主管理:不同于固定表结构的记忆系统;A‑MEM 交给大模型自己决定如何组织记忆、创建链接、更新旧记忆,记忆结构可以适配不同业务任务。
Results. Across six foundation models on multi‑session reasoning tasks, A‑MEM consistently outperforms flat vector stores, summarization‑based memory, and graph‑database approaches, demonstrating that how memories are organized matters as much as what is stored
实验结论:在 6 种不同基座大模型、多会话推理任务上,A‑MEM 效果稳定优于扁平向量库、摘要记忆、普通图数据库记忆方案;证明:记忆的组织方式,和记忆存储的内容本身同等重要。
总结
