Probabilistic distance-based quantizer design for distributed estimation
- Resource Type
- Original Paper
- Authors
- Kim, Yoon Hak
- Source
- EURASIP Journal on Advances in Signal Processing. December 2016 2016(1):1-8
- Subject
- Distributed compression
Distributed source coding (DSC)
Quantizer design
Posterior distribution
KL divergence
Generalized Lloyd algorithm
Source localization
Sensor networks
- Language
- English
- ISSN
- 1687-6180
We consider an iterative design of independently operating local quantizers at nodes that should cooperate without interaction to achieve application objectives for distributed estimation systems. We suggest as a new cost function a probabilistic distance between the posterior distribution and its quantized one expressed as the Kullback Leibler (KL) divergence. We first present the analysis that minimizing the KL divergence in the cyclic generalized Lloyd design framework is equivalent to maximizing the logarithmic quantized posterior distribution on the average which can be further computationally reduced in our iterative design. We propose an iterative design algorithm that seeks to maximize the simplified version of the posterior quantized distribution and discuss that our algorithm converges to a global optimum due to the convexity of the cost function and generates the most informative quantized measurements. We also provide an independent encoding technique that enables minimization of the cost function and can be efficiently simplified for a practical use of power-constrained nodes. We finally demonstrate through extensive experiments an obvious advantage of improved estimation performance as compared with the typical designs and the novel design techniques previously published.