Collective intelligence within web video
Open Access
- 15 June 2013
- journal article
- Published by Springer Nature in Human-centric Computing and Information Sciences
- Vol. 3 (1), 10
- https://doi.org/10.1186/2192-1962-3-10
Abstract
We present a user-based approach for detecting interesting video segments through simple signal processing of users’ collective interactions with the video player (e.g., seek/scrub, play, pause). Previous research has focused on content-based systems that have the benefit of analyzing a video without user interactions, but they are monolithic, because the resulting key-frames are the same regardless of the user preferences. We developed the open-source SocialSkip system on a modular cloud-based architecture and analyzed hundreds of user interactions within difficult video genres (lecture, how-to, documentary) by modeling them as user interest time series. We found that the replaying activity is better than the skipping forward one in matching the semantics of a video, and that all interesting video segments can be found within a factor of two times the average user skipping step from the local maximums of the replay time series. The concept of simple signal processing of implicit user interactions within video could be applied to any type of Web video system (e.g., TV, desktop, tablet), in order to improve the user navigation experience with dynamic and personalized key-frames.Keywords
This publication has 27 references indexed in Scilit:
- SocialSkipPublished by Association for Computing Machinery (ACM) ,2011
- Statistics and Social Network of YouTube VideosPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Video summarisation: A conceptual framework and survey of the state of the artJournal of Visual Communication and Image Representation, 2008
- Video abstraction: A systematic review and classificationACM Transactions on Multimedia Computing, Communications, and Applications, 2007
- A user attention model for video summarizationPublished by Association for Computing Machinery (ACM) ,2002
- SmartSkipPublished by Association for Computing Machinery (ACM) ,2002
- Keyframe-based user interfaces for digital videoComputer, 2001
- An interactive comic book presentation for exploring videoPublished by Association for Computing Machinery (ACM) ,2000
- Browsing digital videoPublished by Association for Computing Machinery (ACM) ,2000
- Video abstractingCommunications of the ACM, 1997