This paper porposed PagedAttentionAlgorithm, inspired by paging technique in OS.It can improve 2~4x memory throughput.
Efficient Memory Management for Large Language Model with PagedAttention
HPC_C2025-11-03 17:10
This paper porposed PagedAttentionAlgorithm, inspired by paging technique in OS.It can improve 2~4x memory throughput.