Manipulation and Compositing of MC-DCT Compressed Video

@article{Chang1995ManipulationAC,
  title={Manipulation and Compositing of MC-DCT Compressed Video},
  author={Shih-Fu Chang and David G. Messerschmitt},
  journal={IEEE J. Sel. Areas Commun.},
  year={1995},
  volume={13},
  pages={1-11}
}
Many advanced video applications require manipulations of compressed video signals. Popular video manipulation functions include overlap (opaque or semitransparent), translation, scaling, linear filtering, rotation, and pixel multiplication. We propose algorithms to manipulate compressed video in the compressed domain. Specifically, we focus on compression algorithms using the discrete cosine transform (DCT) with or without motion compensation (MC). Such compression systems include JPEG, motion… 

Figures and Tables from this paper

Image/video spatial scalability in compressed domain
TLDR
Two novel techniques are proposed, namely, format compatible (FC) discrete cosine transform (DCT) and format modified (FM) DCT to implement image/video spatial scalability directly in the DCT compressed domain to achieve a comparable performance at a much lower computational complexity compared to the spatial-domain techniques.
DCT convolution and its application in compressed domain
TLDR
A discrete cosine transform (DCT)-domain convolution theorem is developed which besides exploiting the sparseness of the DCT-domain representation also exploits the orthogonality and symmetry in the D CT- domain representation to lead to efficient compressed domain-based processing methods unlike their spatial domain counterparts, where such properties are not available.
A DCT-Manipulation Based Algorithm for Scalable Video Coding
TLDR
An efficient algorithm, which manipulates compressed video in the compressed domain, is proposed for arbitrary video downsizing, and a small-range searching method is introduced to increase the accuracy of motion estimation, so that the best motion vector is approximate.
Block-based manipulations on transform-compressed images and videos
TLDR
The paper shows how the inner block transforms can be used to perform many image and video manipulations, by describing the application of IBTs to image subtitling, shearing, and arbitrary angle rotation.
A fast algorithm for DCT-domain inverse motion compensation based on shared information in a macroblock
TLDR
It is shown how shared information within a macroblock, such as a motion vector and common blocks, can be exploited to yield substantial speedup in computation, and can be implemented on top of any optimized solution.
Local bandwidth constrained fast inverse motion compensation for DCT-domain video transcoding
  • Shizhong Liu, A. Bovik
  • Computer Science
    2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221)
  • 2001
TLDR
A novel local bandwidth constrained fast inverse motion compensation algorithm operating in the DCT-domain is proposed that achieves computational improvement of 25% to 55% without visual degradation and a reduction of blocking artifacts in very low bit-rate compressed video sequences.
New algorithms for processing images in the transform-compressed domain
TLDR
This work extends the prior study of transform-domain image manipulation techniques to more complicated image operations such as rotation, shearing, and line-wise special effects, and proposes to extract the individual image rows (columns) first and then apply the previously proposed transform- domain filtering and scaling techniques.
Compressed domain transcoding of MPEG
  • Soam Acharya, B. Smith
  • Computer Science
    Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241)
  • 1998
TLDR
The described technique for compressed domain transcoding differs from previous work because it uses a new approximation approach that is optimized for software implementations and offers an additional degree of freedom: higher transcoding speeds can be obtained at the price of lower picture quality.
An Efficient Scheme for Compressed-Domain Image Mirroring
TLDR
A discrete cosine transform-domain data mirroring scheme is proposed which leads to an efficient compressed domain-based image mirroring method (actually multiplication-free method) unlike its spatial domain counterpart.
A frequency-domain video transcoder for dynamic bit-rate reduction of MPEG-2 bit streams
TLDR
This paper proposes a drift-free MPEG-2 video transcoder, working entirely in the frequency domain, and shows that optimal transcoding of high-quality bit streams can produce better picture quality than that obtained by directly encoding the uncompressed video at the same bit rates using a nonoptimized Test Model 5 (TM5) encoder.
...
...

References

SHOWING 1-10 OF 73 REFERENCES
A new approach to decoding and compositing motion-compensated DCT-based images
A novel decoding algorithm for the MC-DCT (motion-compensation discrete-cosine-transform)-based video, which performs inverse MC before inverse DCT, is designed. This algorithm can be applied in
New algorithms for processing images in the transform-compressed domain
TLDR
This work extends the prior study of transform-domain image manipulation techniques to more complicated image operations such as rotation, shearing, and line-wise special effects, and proposes to extract the individual image rows (columns) first and then apply the previously proposed transform- domain filtering and scaling techniques.
MPEG: a video compression standard for multimedia applications
TLDR
Design of the MPEG algorithm presents a difficult challenge since quality requirements demand high compression that cannot be achieved with only intraframe coding, and the algorithm’s random access requirement is best satisfied with pure intraframes coding.
Algorithms for manipulating compressed images
  • B. Smith, L. Rowe
  • Computer Science
    IEEE Computer Graphics and Applications
  • 1993
TLDR
It is shown how the algebraic operations of pixel-wise and scalar addition and multiplication, which are the basis for many image transformations, can be implemented on compressed images.
Compositing Motion-Compensated Video Within the Network
TLDR
This paper studies the pros and cons of compositing video objects in the networ k nodes rather than in the final receiver sites, and proposes some methods to mitigate the drawbacks and retain the attractiveness of performing video compositing within the network.
Video Post-Production with Compressed Images
TLDR
New methods for performing two video post-production practices directly on subband compressed images, i.e., without decoding them first are presented.
The JPEG still picture compression standard
TLDR
The Baseline method has been by far the most widely implemented JPEG method to date, and is sufficient in its own right for a large number of applications.
Compression of Black-White Images with Arithmetic Coding
A new approach for black and white image compression is described, with which the eight CCITT test documents can be compressed in a lossless manner 20-30 percent better than with the best existing
Motion-compensated television coding: Part I
TLDR
Methods of estimating displacements of moving objects from one frame to the next in a television scene and using such displacements for frame-to-frame prediction by a recursive algorithm are presented which make it attractive for hardware implementation.
Displacement Measurement and Its Application in Interframe Image Coding
TLDR
The motion compensation is applied for analysis and design of a hybrid coding scheme and the results show a factor of two gain at low bit rates.
...
...