Achieving the Fundamental Limit of Lossless Analog Compression via Polarization

Author:

Shuai Yuan, Liuquan Yao, Yuan Li, Huazi Zhang, Jun Wang, Wen Tong, Zhiming Ma

Keyword:

Computer Science, Information Theory, Information Theory (cs.IT)

journal:

date:

2023-12-11 00:00:00

Abstract

In this paper, we study the lossless analog compression for i.i.d. nonsingular signals via the polarization-based framework. We prove that for nonsingular source, the error probability of maximum a posteriori (MAP) estimation polarizes under the Hadamard transform. Building on this insight, we propose partial Hadamard compression and develop the corresponding analog successive cancellation (SC) decoder. The proposed scheme consists of deterministic measurement matrices and non-iterative reconstruction algorithm, providing benefits in both space and computational complexity. Using the polarization of error probability, we prove that our approach achieves the information-theoretical limit for lossless analog compression developed by Wu and Verdu.

PDF: Achieving the Fundamental Limit of Lossless Analog Compression via Polarization.pdf