TY - GEN
T1 - Automatic suggestion of presentation image for storytelling
AU - Liu, Yu
AU - Mei, Tao
AU - Chen, Chang Wen
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/8/25
Y1 - 2016/8/25
N2 - Digital storytelling applications are playing an increasingly important role in people's daily life. In contemporary storytelling applications such as PowerPoint presentation and macro/micro blogs, good presentation images are always highly desired by content creators to boost their presentation in an intuitive and attractive way. Existing studies, however, have not yet addressed the challenging problem of how to select the most appropriate presentation images for storytelling. In this paper, we formulate this problem of presentation image suggestion (given a textual query) as selecting images by maximizing visual and semantic diversity from web image search results of suggested queries. The proposed framework consists of two novel components: 1) click-through-based query suggestion, which is designed to suggest textual queries by searching relevant queries in a constructed query graph that can reflect diverse aspects of a given query, and 2) query-based image selection, which selects the most appropriate presentation images by keeping semantic relevance while maximizing visual diversity and quality, using a novel model based on Conditional Random Field (CRF) by individual and correlation characters. We evaluate the proposed approach by comparing with several baselines and a thorough subjective survey. The evaluations show inspiring results using the proposed approach for automatic suggestion of images for storytelling.
AB - Digital storytelling applications are playing an increasingly important role in people's daily life. In contemporary storytelling applications such as PowerPoint presentation and macro/micro blogs, good presentation images are always highly desired by content creators to boost their presentation in an intuitive and attractive way. Existing studies, however, have not yet addressed the challenging problem of how to select the most appropriate presentation images for storytelling. In this paper, we formulate this problem of presentation image suggestion (given a textual query) as selecting images by maximizing visual and semantic diversity from web image search results of suggested queries. The proposed framework consists of two novel components: 1) click-through-based query suggestion, which is designed to suggest textual queries by searching relevant queries in a constructed query graph that can reflect diverse aspects of a given query, and 2) query-based image selection, which selects the most appropriate presentation images by keeping semantic relevance while maximizing visual diversity and quality, using a novel model based on Conditional Random Field (CRF) by individual and correlation characters. We evaluate the proposed approach by comparing with several baselines and a thorough subjective survey. The evaluations show inspiring results using the proposed approach for automatic suggestion of images for storytelling.
KW - image suggestion
KW - Multimedia presentation
KW - query suggestion
KW - storytelling
UR - https://www.scopus.com/pages/publications/84987642387
U2 - 10.1109/ICME.2016.7552974
DO - 10.1109/ICME.2016.7552974
M3 - Conference contribution
AN - SCOPUS:84987642387
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
BT - 2016 IEEE International Conference on Multimedia and Expo, ICME 2016
PB - IEEE Computer Society
T2 - 2016 IEEE International Conference on Multimedia and Expo, ICME 2016
Y2 - 11 July 2016 through 15 July 2016
ER -