Published April 14, 2015 | Version v1
Software Open

Open perceptual binocular and monocular descriptors for stereoscopic 3D images and video characterization

Authors/Creators

  • 1. Technische Universität Berlin / Telekom Innovation Laboratories

Description

This paper presents a toolbox for monocular and binocular depth estimation and an analysis of performance for some of these. At first, the definition of an appropriate depth indicator (DI) metric for 3D contents is discussed. To this aim, different algorithms from the literature for the characterization of 3D videos are compared. Results show that the simple 7.5 percentile of the disparity map values can already be an indicator, even though it may fail to address several perceptual aspects. In the latter cases, more advanced algorithms presented in this paper may be a better approach. In a second step, monocular depth indicators are described and analyzed in this paper. All code and tools enabling binocular and monocular depth estimation such as depth-map estimation, depth map characterization and monocular depth cue indicator computation is provided open-source. This will enable researchers to further characterize their 3D and 2D contents, for example before running a subjective experiment, or to automatically pre-screen 3D content that is to be presented to a larger number of viewers.

Files

Files (1.9 GB)

Name Size
md5:c163e041fb25e8ff01d32843f8d716fe
1.5 GB Download
md5:4a04dd911d22a943e12d83deff2d914f
392.0 MB Download

Additional details

References

  • Pierre Lebreton and Alexander Raake and Marcus Barkowsky and Patrick Le Callet, "Open perceptual binocular and monocular descriptors for stereoscopic 3D images and video characterization", {I}nternational {W}orkshop on {Q}uality of {M}ultimedia {E}xperience (QoMEX), 2015
  • [1] M. S. Landy, L. T. Maloney, E. B. Johnston, and M. Young, “Mea- surement and modeling of depth cue combination: in defense of weak fusion,” Vision Research, vol. 35, no. 3, pp. 389–412, 1995.
  • [2] M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx, “Visual discomfort and visual fatigue of stereoscopic displays: A review,” Journal of Imaging Science and Technology, vol. 53(3), pp. 1–14, 2009.
  • [3] W. Chen, J. Fournier, M. Barkowsky, and P. L. Callet, “New stereo- scopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone,” Stereoscopic Displays and Applications XXII. Proceedings of the SPIE, vol. 7863, pp. 78631O–78631O–13, 2011.
  • [4] A. R. Reibman, “Designing a biased specification-based subjective test of image quality,” in Proceeding of the SPIE, Human Vision and Electronic Imaging XX, 2015.
  • [5] ITU-T Recommendation P.910, “Subjective video quality assessment methods for multimedia applications,” 2008.
  • [6] H. Sohn, Y. J. Jung, S. Lee, H. W. Park, and andYong Man Ro, “Investigation of object thickness for visual discomfort prediction in stereoscopic image,” in Proceedings SPIE 8288, Stereoscopic Displays and Applications XXIII, vol. 8288, 2012.
  • [7] S. Toyosawa and T. Kawai, “Measurement of perceived stereoscopic sensation through disparity metrics and compositions,” in Stereoscopic Displays and Applications XXV, vol. 9011, San Francisco, California, USA, 2014.
  • [8] T.-H. Lin and S.-J. Hu, “Perceived depth analysis for view navigation of stereoscopic three-dimensional models,” Journal of Electronic Imaging, vol. 23, no. 4, p. 043014, 2014.
  • [9] P. Lebreton, A. Raake, M. Barkowsky, and P. L. Callet, “Evaluating depth perception of 3D stereoscopic videos,” IEEE Journal of Selected Topics in Signal Processing, vol. 6, pp. 710–720, October 2012.
  • [10] N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62–66, 1979.
  • [11] M. Ross and A. Oliva, “Estimating perception of scene layout properties from global image features,” Journal of vision, vol. 10, no. 1, 2010.
  • [12] L. Goldmann, T. Ebrahimi, P. Lebreton, and A. Raake, “Towards a descriptive depth index for 3D content : measuring perspective depth cues,” in VPQM, Scottsdale, Arizona, USA, 2012.
  • [13] P. Lebreton, A. Raake, M. Barkowsky, and P. L. Callet, “Perceptual depth indicator for S-3D content based on binocular and monocular cues,” in Asilomar, 2012.
  • [14] P. Lebreton, A. Raake, M. Barkovsky, and P. L. Callet, “Measuring perceived depth in natural images and study of its relation with monocular and binocular depth cues,” in Stereoscopic Displays and Applications XXV, San Francisco, California, USA, 2014.
  • [15] M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof, “Anisotropic Huber-L1 Optical Fow,” in Proceedings of the British Machine Vision Conference (BMVC), London, UK, September 2009.
  • [16] “http://vision.middlebury.edu/stereo/eval/.”
  • [17] ITU-T Recommendation P.1401, “Methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models,” 2012.
  • [18] C.-W. Chen and Y.-Y. Chen, “Recovering depth from a single image using spectral energy of the defocused step edge gradient,” in 18th IEEE International Conference on Image Processing (ICIP), 2011, pp. 1981–1984.