矩阵算子 A 与矩阵算子 B 的 相对熵

In the context of matrix operators (linear operators on finite-dimensional inner product spaces), the concept of relative entropy typically arises in quantum information theory and statistical mechanics , where matrices represent density operators (positive semidefinite, trace 1).

If AA and BB are positive definite matrices (or operators) acting on a Hilbert space, the relative entropy of AA with respect to BB is defined as:


Key properties:

  1. Domain:

    • and are positive semidefinite (often with for finiteness).

    • If is a density operator (trace 1), then , with equality iff .

  2. Relation to quantum relative entropy :

    This is the Umegaki relative entropy, fundamental in quantum information (e.g., quantum Stein's lemma, data processing inequality).

  3. When A, B are classical :

    If and are diagonal in the same basis with entries and ​, then

    which is the classical Kullback--Leibler divergence.


Example:

Let

, .

Then


Generalizations:

  • For positive semidefinite with , the relative entropy is .

  • In von Neumann algebras, there's an extension to general states.


If your operators and are not necessarily density matrices (trace ≠ 1 or not positive), the "relative entropy" may refer to other divergences (e.g., Bregman divergence for matrix functions), but the standard term in matrix analysis / quantum information is the quantum relative entropy defined above.

More to see its differentiability , joint convexity, or an application (e.g., in quantum hypothesis testing)

相关推荐
whitelbwwww1 天前
cuBLAS--CUDA高性能线性代数计算库--第一部分
c++·线性代数·gpu算力·cuda c++
量子客2 天前
Alice & Bob超导路线图加速:2030年目标翻倍,2032破千逻辑量子比特
量子计算
搬砖魁首2 天前
后量子密码系列 - (6)量子计算,量子密码与后量子密码的关联与区别
量子计算·后量子密码·量子密码
JianZhen✓2 天前
电商 SKU 选择器:后端只给扁平列表,前端怎么反推规格矩阵并做到 O(1) 命中
前端·矩阵·状态模式
量子客4 天前
IBM、AMD正式开源「量子纠错解码评估框架」,突破多GPU调度,量子解码吞吐量提升达7.5 倍
开源·量子计算
tellmewhoisi5 天前
深度学习0:数学知识:(雅可比矩阵)
人工智能·深度学习·矩阵
如夏倾城8 天前
基于格的密码学
安全·密码学·量子计算·可信计算技术
lisw0511 天前
Dayhoff的PAM替换矩阵理论评介!
线性代数·算法·矩阵
DFT计算杂谈12 天前
可DIY布里渊区图像绘制编辑器
人工智能·机器学习·语言模型·矩阵·编辑器