TY - GEN
T1 - Quantization for classification accuracy in high-rate quantizers
AU - Dogahe, Behzad Mohammadi
AU - Murthi, Manohar N.
PY - 2011/4/21
Y1 - 2011/4/21
N2 - Quantization of signals is required for many transmission, storage and compression applications. The original signal is quantized at the encoder side. At the decoder side, a replica of the original signal that should resemble the original signal in some sense is recovered. Present quantizers make an effort to reduce the distortion of the signal in the sense of reproduction fidelity. Consider scenarios in which signals are generated from multiple classes. The encoder focuses on the task of quantizing the data without any regards to the class of the signal. The quantized signal reaches the decoder where not only the recovery of the signal should take place but also a decision is to be made on the class of the signal based on the quantized version of the signal only. In this paper, we study the design of such scalar quantizer that is optimized for the task of classification at the decoder. We define the distortion to be the symmetric Kullback-Leibler (KL) divergence measure between the conditional probabilities of class given the signal before and after quantization. A high-rate analysis of the quantizer is presented and the optimum point density of the quantizer for minimizing the symmetric KL divergence is derived. The performance of this method on synthetically generated data is examined and observed to be superior in the task of classification of signals at the decoder.
AB - Quantization of signals is required for many transmission, storage and compression applications. The original signal is quantized at the encoder side. At the decoder side, a replica of the original signal that should resemble the original signal in some sense is recovered. Present quantizers make an effort to reduce the distortion of the signal in the sense of reproduction fidelity. Consider scenarios in which signals are generated from multiple classes. The encoder focuses on the task of quantizing the data without any regards to the class of the signal. The quantized signal reaches the decoder where not only the recovery of the signal should take place but also a decision is to be made on the class of the signal based on the quantized version of the signal only. In this paper, we study the design of such scalar quantizer that is optimized for the task of classification at the decoder. We define the distortion to be the symmetric Kullback-Leibler (KL) divergence measure between the conditional probabilities of class given the signal before and after quantization. A high-rate analysis of the quantizer is presented and the optimum point density of the quantizer for minimizing the symmetric KL divergence is derived. The performance of this method on synthetically generated data is examined and observed to be superior in the task of classification of signals at the decoder.
KW - Classification
KW - High Rate Theory
KW - Kullback-Leibler Divergence Measure
KW - Quantization
UR - http://www.scopus.com/inward/record.url?scp=79954548820&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79954548820&partnerID=8YFLogxK
U2 - 10.1109/DSP-SPE.2011.5739225
DO - 10.1109/DSP-SPE.2011.5739225
M3 - Conference contribution
AN - SCOPUS:79954548820
SN - 9781612842271
T3 - 2011 Digital Signal Processing and Signal Processing Education Meeting, DSP/SPE 2011 - Proceedings
SP - 277
EP - 282
BT - 2011 Digital Signal Processing and Signal Processing Education Meeting, DSP/SPE 2011 - Proceedings
T2 - 2011 Digital Signal Processing and Signal Processing Education Meeting, DSP/SPE 2011
Y2 - 4 January 2011 through 7 January 2011
ER -