Jointly Optimized Spatial Prediction and Block Transform for Video and Image Coding

@article{Han2012JointlyOS,
  title={Jointly Optimized Spatial Prediction and Block Transform for Video and Image Coding},
  author={Jingning Han and Ankur Saxena and Vinay Melkote and Kenneth M. Rose},
  journal={IEEE Transactions on Image Processing},
  year={2012},
  volume={21},
  pages={1874-1884}
}
This paper proposes a novel approach to jointly optimize spatial prediction and the choice of the subsequent transform in video and image compression. Under the assumption of a separable first-order Gauss-Markov model for the image signal, it is shown that the optimal Karhunen-Loeve Transform, given available partial boundary information, is well approximated by a close relative of the discrete sine transform (DST), with basis vectors that tend to vanish at the known boundary and maximize… 
View on IEEE
scl.ece.ucsb.edu
95 Citations
Highly Influential Citations
8
Background Citations
27
Methods Citations
37
Results Citations
1

Figures and Tables from this paper

95 Citations

Block-Based Spatial Prediction and Transforms Based on 2D Markov Processes for Image and Video Compression
  • Fatih Kamisli
  • Computer Science
    IEEE Transactions on Image Processing
  • 2015
TLDR
The derived overall intraframe coding approaches can generalize the mentioned two approaches, provide improved coding gains and produce less blocking effects at low bitrates.
Enhanced Multiple Transform for Video Coding
TLDR
To further improve the transform efficiency, an Enhanced Multiple Transform (EMT) scheme is proposed and has been implemented on top of High-Efficiency Video Coding (HEVC) reference software, and significant coding gain has been verified.
An optimized template matching approach to intra coding in video/image compression
TLDR
This work significantly extends the scope of the template matching approach, which is typically followed by a conventional discrete cosine transform for the prediction residuals, by employing an asymmetric discrete sine transform (ADST), whose basis functions vanish at the prediction boundary and reach maximum magnitude at far end to fully exploit statistics of the residual signals.
DCT/DST-Based Transform Coding for Intra Prediction in Image/Video Coding
TLDR
The results show that the DCT/DST scheme provides significant BD-rate improvement over the conventional DCT based scheme for intra prediction in video sequences.
Efficient H.264/AVC Video Coding with Adaptive Transforms
TLDR
A novel content adaptive transform framework for the H.264/AVC-based video coding by utilizing pixel rearrangement to dynamically adjust the transform kernels to adapt to the video content and a spiral-scanning method is developed to reorder the transform coefficients for better entropy coding.
Scene-based KLT for Intra Coding in HEVC
Transform coding and quantization are part of the cornerstones in the current High Efficiency Video Coding (HEVC) standard. They are applied on the residuals from inter-frame or intra predictions.…
Improving Intra Prediction in High-Efficiency Video Coding
TLDR
A novel intra prediction scheme is proposed based on the analysis that smoothing the copying-based prediction can derive a better prediction block and the effects when the pixel values deviate from the model and the predicted pixel is far away from the reference pixels.
Joint Separable and Non-Separable Transforms for Next-Generation Video Coding
TLDR
In order to achieve higher transform coding gains with relatively low-complexity implementations, a joint separable and non-separable transform is proposed, named enhanced multiple transform (EMT), applies multiple transform cores from a pre-defined subset of sinusoidal transforms, and the transform selection is signaled in a joint block level manner.
On secondary transforms for scalable video coding
TLDR
Simulation results show that the proposed transform scheme provides significant BD-Rate improvement over the conventional DCT-based coding scheme for video sequences in the ongoing scalable extensions of HEVC standardization.
H.264 intra coding with transforms based on prediction inaccuracy modeling
  • Xun Cai, J. Lim
  • Computer Science
    2016 IEEE International Conference on Image Processing (ICIP)
  • 2016
TLDR
This paper implements the transforms based on prediction inaccuracy modeling on the H.264 intra coding system and implements the proposed transform, which is used in hybrid with the ADST.
...
...

References

SHOWING 1-10 OF 36 REFERENCES
Towards jointly optimal spatial prediction and adaptive transform in video/image coding
TLDR
This paper proposes a new approach to combined spatial (Intra) prediction and adaptive transform coding in block-based video and image compression, which is implemented within the H.264/AVC intra mode, and is shown in experiments to significantly outperform the standard intra modes, and achieve significant reduction of the blocking effect.
Intra-Predictive Transforms for Block-Based Image Coding
TLDR
The theory and the design of intra-predictive transforms, which unify the inter-block prediction and block-based transforms in block- based image coding, are presented and it turns out that the coding gain can be greater than that of conventional transforms.
A new image data compression method–extrapolative prediction–discrete sine transform coding (in the case of one–dimensional coding)
TLDR
It is shown theoretically that the coding efficiency of the proposed method is nearly the same as those of the discrete 16-pixel cosine transform with block length of 4 pixels and the 8-pixel fast Karhunen-Loeve transform, and to be especially advantageous in the hardware realization.
DCT/DST alternate-transform image coding
TLDR
An image coding method for low bit rates based on alternate use of the discrete cosine transform and the discrete sine transform on image blocks achieves the removal of redundancies in the correlation between neighboring blocks as well as the preservation of continuity across the block boundaries.
Directional Discrete Cosine Transforms—A New Framework for Image Coding
  • B. Zeng, Jingjing Fu
  • Computer Science
    IEEE Transactions on Circuits and Systems for Video Technology
  • 2008
TLDR
A new block-based DCT framework in which the first transform may choose to follow a direction other than the vertical or horizontal one, which is able to provide a better coding performance for image blocks that contain directional edges.
Optimal block-overlapping synthesis transforms for coding images and video at very low bitrates
TLDR
Results show that the proposed inverse block-overlapping transforms can significantly outperform the conventional inverse DCT both in terms of objective and subjective quality measures.
Performance evaluation of Motion-JPEG2000 in comparison with H.264/AVC operated in pure intracoding mode
TLDR
This paper reports on a comparative study of the rate-distortion performance of Motion-JPEG2000 and H.264/AVC using a representative set of video material, and results indicate that H. 264/ AVC performs surprisingly well on individually coded pictures in comparison to the highly sophisticated still image compression technology of JPEG2000.
Improved h.264 intra coding based on bi-directional intra prediction, directional transform, and adaptive coefficient scanning
  • Yan Ye, M. Karczewicz
  • Computer Science
    2008 15th IEEE International Conference on Image Processing
  • 2008
TLDR
Together the improvements can bring on average 7% and 10% coding gain for CABAC and for CAVLC, respectively, with average coding gain of 12% for HD sequences.
The LOT: transform coding without blocking effects
An exact derivation of an optimal lapped orthogonal transform (LOT) is presented. The optimal LOT is related to the discrete cosine transform (DCT) in such a way that a fast algorithm for a nearly…
Overview of the H.264/AVC video coding standard
TLDR
An overview of H.264/MPEG-4 AVC is provided and some comparisons with the existing standards, MPEG-2 and MPEG-4 Part 2, are also provided.
...
...