Please use this identifier to cite or link to this item:
http://tainguyenso.dut.udn.vn/handle/DUT/4124
Title: | Saliency prediction for 360-degree video | Authors: | Vo, Hoang Chuong | Keywords: | 360-degree video;Convolution;Convolutional network;Spherical convolutional network | Issue Date: | 2020 | Publisher: | Trường Đại học Bách khoa - Đại học Đà Nẵng | Abstract: | Saliency detection simulates human's perception in locating crucial regions, enabling further processing for many practical applications. Even though saliency prediction for conventional 2D images and videos have been well developed, prediction on 360° contents is still challenging. For each pixel in the equirectangular frame, there will be corresponding surrounding pixels according to their spherical coordinate. Therefore, the conventional convolution method may induce certain inaccuracy in attempt to simulate humans perceive the surrounding environment. We propose a novel spherical convolutional network concentrating on 360° video saliency prediction in which the kernel is defined as a spherical cap. In the process of convolution, instead of using neighboring pixels with regular relationship in the equirectangular projection coordinate, the convolutional patches will be changed in order to preserve the spherical perspective of the spherical signal. Our model is trained and tested on the dataset including 104 360° videos that comprise dynamic sporty content. The proposed spherical convolutional network is evaluated by Pearson correlation coefficient (CC) and Kullback–Leibler divergence (KLD). Our experiments show the efficiency of our proposed spherical convolution method’s application in 360° video saliency detection utilizing spherical U-Net model. |
Description: | DA.FA.20.026 ; 62 p. |
URI: | http://tainguyenso.dut.udn.vn/handle/DUT/4124 |
Appears in Collections: | DA.Điện tử - Viễn thông |
Files in This Item:
File | Description | Size | Format | Existing users please Login |
---|---|---|---|---|
7.DA.FA.20.026.VoHoangChuong.pdf | Thuyết minh | 13.65 MB | Adobe PDF | Request a copy |
CORE Recommender
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.