ULB ChocoFountainBxl

ULB ChocoFountainBxl sequence by LISA ULB

The test sequence "ULB ChocoFountainBxl" is provided by Daniele Bonatto, Sarah Fachada, Mehrdad Teratani and Gauthier Lafruit, members of the LISA department, EPB (Ecole Polytechnique de Bruxelles), ULB (Université Libre de Bruxelles), Belgium.

View Synthesis Sample

License

License Creative Commons 4.0 - CC BY 4.0

Terms of Use

Any kind of publication or report using this sequence should refer to the following references.

[1] Daniele Bonatto, Sarah Fachada, Mehrdad Teratani, Gauthier Lafruit, "ULB ChocoFountainBxl", Zenodo, 10.5281/zenodo.5960227, 2022.

@misc{bonatto_chocofountainbxl_2022,
    title = {{ULB} {ChocoFountainBxl}},
    author = {Bonatto, Daniele and Fachada, Sarah and Teratani, Mehrdad and Lafruit, Gauthier},
    publisher = {Zenodo}
    month = feb,
    year = {2022},
    doi = {10.5281/zenodo.5960227}
}

[2] A. Schenkel, D. Bonatto, S. Fachada, H.-L. Guillaume, et G. Lafruit, "Natural Scenes Datasets for Exploration in 6DOF Navigation", in 2018 International Conference on 3D Immersion (IC3D), Brussels, Belgium, déc. 2018, p. 1-8. doi: 10.1109/IC3D.2018.8657865.

@inproceedings{schenkel_natural_b_2018,
    address = {Brussels, Belgium},
    title = {Natural {Scenes} {Datasets} for {Exploration} in {6DOF} {Navigation}},
    isbn = {978-1-5386-7590-8},
    url = {https://doi.org/10.1109/IC3D.2018.8657865},
    doi = {10.1109/IC3D.2018.8657865},
    language = {en},
    urldate = {2019-04-11},
    booktitle = {2018 {International} {Conference} on {3D} {Immersion} ({IC3D})},
    publisher = {IEEE},
    author = {Schenkel, Arnaud and Bonatto, Daniele and Fachada, Sarah and Guillaume, Henry-Louis and Lafruit, Gauthier},
    month = dec,
    year = {2018},
    pages = {1--8}
}

Production

Laboratory of Image Synthesis and Analysis, LISA department, Ecole Polytechnique de Bruxelles, Universite Libre de Bruxelles, Belgium.

Content

This dataset contains a dynamic test scene created using the acquisition system described in [2] (3x5 array with a baseline of 10 cm (vertical) and 15cm horizontal).
We provide color corrected [4] 97 frames RGB textures (YUV420p10le format) captured using 15 4k micro studio Blackmagic cameras (3840x2160 pixels @ 30 fps cropped to 3712x2064).
We also provide corresponding depth maps (YUV420p16le format) estimated using MPEG's Immersive Video Depth Estimation (IVDE) [5] and refined using PDR [6].

The scene display two actors interacting with difficult objects to render in view synthesis. In particular the scene contains transparent, specular and smooth areas objects.
The videos were taken in a controlled light environment.

The views are disposed as follow:

In addition to the images and their depth maps, an accurate camera calibration file is provided following the format of [8].

The dataset contains:

- a `camera.json` file in OMAF coordinates system (Camera position: X: forwards, Y:left, Z: up, Rotation: yaw, pitch, roll) [9],
- a `view_synthesis_config.zip` folder containing configuration files for RVS [7,8] to synthesize every view with its closest 4 neighbors in a "plus" configuration,
- a `view_synthesis_results.zip` folder containing videos (scaled to 710x516) corresponding to the configuration files in `view_synthesis_config` and a multiview videos displaying all the results merged together. Views synthesized with RVS [7,8],
- a `vXY_depth_3712x2064_yuv420p16le.zip` Depth maps for every XY view in yuv420p16le format,
- a `vXY_texture_3712x2064_yuv420p10le.zip` RGB textures for every XY view in yuv420p10le format.

References and links

[4] A. Dziembowski, D. Mieloch, S. Różek and M. Domański, "Color Correction for Immersive Video Applications," in IEEE Access, vol. 9, pp. 75626-75640, 2021, doi: 10.1109/ACCESS.2021.3081870.
[5] D. Mieloch, O. Stankiewicz and M. Domański, "Depth Map Estimation for Free-Viewpoint Television and Virtual Navigation", IEEE Access, vol. 8, pp. 5760-5776, 2020, doi: 10.1109/ACCESS.2019.2963487.
[6] D. Mieloch, A. Dziembowski and M. Domański, "Depth Map Refinement for Immersive Video," in IEEE Access, vol. 9, pp. 10778-10788, 2021, doi: 10.1109/ACCESS.2021.3050554.
[7] D. Bonatto, S. Fachada, S. Rogge, A. Munteanu and G. Lafruit, "Real-Time Depth Video-Based Rendering for 6-DoF HMD Navigation and Light Field Displays," in IEEE Access, vol. 9, pp. 146868-146887, 2021, doi: 10.1109/ACCESS.2021.3123529.
[8] S. Fachada, B. Kroon, D. Bonatto, B. Sonneveldt, et G. Lafruit, "Reference View Synthesizer (RVS) 2.0 manual, [N17759]", july. 2018.
[9] S. Fachada, D. Bonatto, M. Teratani, and G. Lafruit, "Intechopen - View Synthesis tool for VR Immersive Video", 2022.

Acknowledgments

[G1] EU project HoviTron, Grant Agreement n$^o$951989 on Interactive Technologies, Horizon 2020.
[G2] Innoviris, the Brussels Institute for Research and Innovation, Belgium, under contract No.: 2015-DS-39a/b & 2015-R-39c/d, 3DLicorneA.
[G3] Sarah Fachada is a Research Fellow of the Fonds de la Recherche Scientifique - FNRS, Belgium.