Find in Library
Search millions of books, articles, and more
Indexed Open Access Databases
Spatiotemporal Modeling for Video Summarization Using Convolutional Recurrent Neural Network
oleh: Yuan Yuan, Haopeng Li, Qi Wang
Format: | Article |
---|---|
Diterbitkan: | IEEE 2019-01-01 |
Deskripsi
In this paper, a novel neural network named CRSum for the video summarization task is proposed. The proposed network integrates feature extraction, temporal modeling, and summary generation into an end-to-end architecture. Compared with previous work on this task, the proposed method owns three distinctive characteristics: 1) it for the first time leverages convolutional recurrent neural network for simultaneously modeling spatial and temporal structure of video for summarization; 2) thorough and delicate features of video are obtained in the proposed architecture by trainable three-dimension convolutional neural networks and feature fusion; and 3) a new loss function named Sobolev loss is defined, aiming to constrain the derivative of sequential data and exploit potential temporal structure of video. A series of experiments are conducted to prove the effectiveness of the proposed method. We further analyze our method from different aspects by well-designed experiments.