[LS2N_IPI_DIBR_Videos] 3D-TV System with Depth-Image-Based Rendering Architectures, Techniques and Challenges
Authors/Creators
-
1.
Nantes Université
-
2.
Laboratoire des Sciences du Numérique de Nantes
Description
Presentation & Goal
The IRCCyN IVC DIBR Videos quality database contains 102 video sequences of 6 seconds in 1024x768 resolution with between 15 and 30 frames per second. Individual votes and Mean Opinion Scores (MOS) obtained by an Absolute Category Rating with Hidden Reference (ACR-HR) experiment are provided.
Three different multiview plus depth (MVD) sequences are considered in this database. The sequences are Book Arrival (1024x768, 16 cameras with 6.5cm spacing), Lovebird1 (1024x768, 12 cameras with 3.5 cm spacing) and Newspaper (1024x768, 9 cameras with 5 cm spacing). Seven DIBR algorithms processed the three sequences to generate, for each sequence, four new viewpoints.
Initial goal
This database was done to consider the reliability of usual assessment methods when evaluating virtual synthesized views in the multiview video context. Virtual views are generated from Depth Image Based Rendering (DIBR) algorithms. Because DIBR algorithms involve geometric transformations, new types of artifacts come up. The question regards the ability of commonly used methods to deal with such artifacts.
Possible usage
This video quality database can be used to test a video quality metric precision in a context of DIBR.
Dataset description
We used Absolute Category Rating - Hidden Reference (ACR-HR) and as test methodology.
We provide a spreadsheet with the individual scores, the Mean Opinion Score (MOS) and the Differential Mean Opinion Score (DMOS) for each of the 102 Processed Video Sequences (PVS).
The PVS (avi videos) are available on our FTP server and are in the AVI format.
The information about the source contents, video tested generation, subjective experiment environment and available data are provided in a description file.
Source contents (SRC)
Source number |
Source name |
Description |
|
|---|---|---|---|
| 01 | Book Arrival | Description : A man in an office standing up to welcome another man. Author : Heinrich-Hertz-Institut. Video frame rate : 15Hz Number of frames : 100 |
|
| 02 | Lovebird1 | Description : A couple walking in front of a temple. Author : Electronics and Telecommunications Research Institute (ETRI). Video frame rate : 30Hz Number of frames : 150 |
|
| 03 | Newspaper | Description : A man and a girl reading the newspaper around a table when a man coming behind them. Author : Gwangju Institute of Science and Technology (GIST). Video frame rate : 30Hz Number of frames : 200 |
Hypothetical Reference Circuits (HRC)
The Processed Video Sequences (PVS) were created using the following Hypothetical Reference Circuits (HRC).
| HRC name | HRC description |
|---|---|
| cam_xx | [No impairment - Reference sequence view 1] |
| cam_yy | [No impairment - Reference sequence view 2] |
| cam_zz | [No impairment - Reference sequence view 3] |
| A1 | Fehn cropped : where the depth map is pre-processed by a low-pass filter. Borders are cropped, and then an interpolation is processed to reach the original size. |
| A2 | Fehn interpolated : Borders are inpainted by the method proposed by Telea |
| A3 | Tanimoto et al., it is the recently adopted reference software for the experiments in the 3D Video group of MPEG. |
| A4 | Müller et al., proposed a hole filling method aided by depth information. |
| A5 | Ndjiki-Nya et al., the hole filling method is a patch-based texture synthesis. |
| A6 | Köppel et al., uses depth temporal information to improve the synthesis in the disoccluded areas. |
| A7 | corresponds to the unfilled sequences (i.e. with holes). |
| cam_xx_qp26 | Reference sequence view 1 coded by H.264 with a QP = 26 |
| cam_xx_qp34 | Reference sequence view 1 coded by H.264 with a QP = 34 |
| cam_xx_qp44 | Reference sequence view 1 coded by H.264 with a QP = 44 |
There are several references (3 first lines of the table) for each content, because there are the 3 views used for each content. So there are 3 HRC with no impairment.
Experiment information
Features |
Value |
| Highlights of this database | Depth Images Based Rendering |
| Free-viewpoint | |
| video quality | |
| Video | |
| Frame frequency | 30 or 15Hz |
| Video format | 1024x768 |
| Video length | 100, 150 or 200 frames |
| Video duration | 5 to 7 seconds |
| Number of videos | 102 |
| Subjective test | |
| Observation distance | 4H |
| Environment | ITU-R BT.500-11 |
| Background luminance | 25cd/m² |
| Methodology | ACR |
| Duration | 30 minutes |
| Pre screening | Snellen, Ishihara |
| Post screening (Rejection method) | VQEG Multimedia |
| Observers | |
| Number of observers | 32 naives |
| Display | |
| Display | TVLogic LMV401 |
| Display resolution | Full HD (1920x1080 pixels) |
| Display frequency | 60Hz |
| Display mode | progressive |
| Display luminance max | 180cd/m² |