Title: Motion and depth modelling for media compression and beyond
Speaker: Professor David Taubman
This presentation is concerned with novel ways to describe and reason with motion and disparity information, considering both compression and frame/view interpolation.
In video compression, motion is almost invariably described at the (target) frames that need to be predicted from other previously decoded (reference) frames. This target-anchored motion provides a convenient heuristic for motion-compensated prediction, but cannot easily be re-purposed for the prediction or synthesis of other frames. This is a problem for temporal frame interpolation, and also for scalable video coding. Moreover, with multiple-reference frames, target-anchored motion provides multiple ways to infer new motion relationships within a video sequence, which are not generally consistent. The presentation explores the merits of reference-anchored motion descriptions and ultimately an even more general approach that we identify as base-anchored, focussing on temporal consistency, redundancy avoidance, and the role of motion in post processing.
Central to the success of non-target-anchored motion is the estimation, coding and proper exploitation of discontinuities in the 2D projected motion fields. Fortunately, we are now reaching the point when these pre-requesites are achievable. The speaker will present recent results demonstrating the benefits of reference and base anchored motion. The presentation will also cover recent work on disparity-compensated compression of camera array data, where the same methods are used to code and reason with disparity fields. Finally, the speaker will provide a high level vision for the evolution of media coding technology that demonstrates both the need to shift away from target-anchored approaches and the opportunities for research.
About the Speaker:
Professor Taubman is with the School of Electrical Engineering and Telecommunications at the University of New South Wales, where he is currently Deputy Head of School (Research). Before joining UNSW at the end of 1998, he spent 4 years at Hewlett-Packard's research laboratories in Palo Alto, California. He received the B.S. and B.E. (Electrical) degrees in 1986 and 1988 from the University of Sydney, Australia, and the M.S. and Ph.D. degrees in 1992 and 1994 from the University of California at Berkeley.
Professor Taubman contributed extensively to the JPEG2000 standard for image compression and the JPIP standard for interactive image communication. His important contributions to scalable video compression and motion modelling are also widely known. Professor Taubman is author, with Michael Marcellin, of the book "JPEG2000: Image compression fundamentals, standards and practice" and author of the popular "Kakadu" software tools for JPEG2000 developers. He is recipient of two IEEE Best Paper awards: for the 1996 paper, "A Common Framework for Rate and Distortion Based Scaling of Highly Scalable Compressed Video;" and for the 2000 paper, "High Performance Scalable Image Compression with EBCOT". Professor Taubman was a featured Plenary speaker at ICIP'2006, WIAMIS'2010, PCS’2013, amongst other major speaking engagements. He is Fellow of the IEEE and the IEAust. His research interests include scalable image and video compression, interactive, robust and efficient communication of multimedia content, motion modelling and estimation and statistical inverse problems.