Please use this identifier to cite or link to this item: http://tainguyenso.dut.udn.vn/handle/DUT/4124
Title: Saliency prediction for 360-degree video
Authors: Vo, Hoang Chuong
Keywords: 360-degree video;Convolution;Convolutional network;Spherical convolutional network
Issue Date: 2020
Publisher: Trường Đại học Bách khoa - Đại học Đà Nẵng
Abstract: 
Saliency detection simulates human's perception in locating crucial regions, enabling further processing for many practical applications. Even though saliency prediction for conventional 2D images and videos have been well developed, prediction on 360° contents is still challenging. For each pixel in the equirectangular frame, there will be corresponding surrounding pixels according to their spherical coordinate. Therefore, the conventional convolution method may induce certain inaccuracy in attempt to simulate humans perceive the surrounding environment. We propose a novel spherical convolutional network concentrating on 360° video saliency prediction in which the kernel is defined as a spherical cap. In the process of convolution, instead of using neighboring pixels with regular relationship in the equirectangular projection coordinate, the convolutional patches will be changed in order to preserve the spherical perspective of the spherical signal. Our model is trained and tested on the dataset including 104 360° videos that comprise dynamic sporty content. The proposed spherical convolutional network is evaluated by Pearson correlation coefficient (CC) and Kullback–Leibler divergence (KLD). Our experiments show the efficiency of our proposed spherical convolution method’s application in 360° video saliency detection utilizing spherical U-Net model.
Description: 
DA.FA.20.026 ; 62 p.
URI: http://tainguyenso.dut.udn.vn/handle/DUT/4124
Appears in Collections:DA.Điện tử - Viễn thông

Files in This Item:
File Description SizeFormat Existing users please Login
7.DA.FA.20.026.VoHoangChuong.pdfThuyết minh13.65 MBAdobe PDF
    Request a copy
Show full item record

CORE Recommender

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.