- Published 2009 in 2009 Information Theory and Applications Workshop

Causal video coding is considered from an information theoretic point of view, where video source frames X<inf>1</inf>,X<inf>2</inf>, …,X<inf>N</inf> are encoded in a frame by frame manner, the encoder for each frame X<inf>k</inf>, k = 1, … ,N, can use all previous frames and all previous encoded frames while the corresponding decoder can use only all previous encoded frames, and each frame X<inf>k</inf> itself is modeled as a source X<inf>k</inf> = {X<inf>k</inf>(i)}<inf>i=1</inf><sup>∞</sup>. A novel computation approach is proposed to analytically characterize, numerically compute, and compare the minimum total rate of causal video coding R<inf>c</inf>(D<inf>1</inf>, … ,D<sup>N</sup>) required to achieve a given distortion (quality) level D<inf>1</inf>, … ,D<inf>N</inf> ≥ 0. Specifically, we first show that for jointly stationary ergodic sources X<inf>1</inf>,X<inf>2</inf>, … ,X<inf>N</inf>, R<inf>c</inf>(D<inf>1</inf>, … ,D<inf>N</inf>) is equal to the infimum of the nth order total rate distortion function R<inf>c,n</inf>(D<inf>1</inf>, … ,D<inf>N</inf>) over all n, where <inf>Rc,n</inf>(D<inf>1</inf>, … ,D<inf>N</inf>) itself is given by the minimum of an information quantity over a set of auxiliary random variables. We then present an iterative algorithm for computing R<inf>c,n</inf>(D<inf>1</inf>, … ,D<inf>N</inf>) and demonstrate the convergence of the algorithm to the global minimum. The global convergence of the algorithm further enables us to establish a single-letter characterization of R<inf>c</inf>(D<inf>1</inf>, … ,D<inf>N</inf>) in a novel way when the N sources are an independent and identically distributed (IID) vector source. With the help of the algorithm, we also demonstrate a surprising result (dubbed the more and less coding theorem–under some conditions on source frames and distortion, the more frames need to be encoded and transmitted, the less amount of data has to be actually sent. Predictive video coding, where each encoder and its corresponding decoder can use only all previous encoded frames, is also investigated.

@article{Yang2009OnTR,
title={On the rate distortion theory for causal video coding},
author={En-Hui Yang and Lin Zheng and Da-ke He and Zhen Zhang},
journal={2009 Information Theory and Applications Workshop},
year={2009},
pages={385-391}
}