Interactive and audience-adaptive information interfaces

Robert Ravnik (2013) Interactive and audience-adaptive information interfaces. PhD thesis.

Preview

PDF Download (33Mb)

Abstract

This doctoral thesis develops an interactive and user-adaptive information interface based on computer vision and machine learning methods. The selected methodology is chosen to optimise the balance between accuracy and time complexity, subjected to design-aim to perform in real-time and using conventional hardware. More particularly, we use the Mixture of Gaussians method for background segmentation, Viola & Jones method for face detection algorithm, Active Appearance Models for face alignment and POSIT algorithm for head pose estimation. The developed interface is used as the key research tool to explore three currently open problems in the field of human-computer interaction: dynamic anamorphosis, quantitative audience measurement study of digital signage in real-world environment, and modeling of the purchase decision process. In the first study, we develop a new interactive method -the dynamic anamorphosis- that in real time, adapts the projected image to the observer's position by using anamorphic transformation. As an interesting application, we show that dynamic anamorphosis notably improves eye-contact in videoconferencing. In the second study, we use the developed interface to perform a quantitative audience measurement field study, which evaluates the user attention. The study shows significant attentional differences related to demographic and broadcasting features; especially interesting are conversion rates of the attention phases. In the third study, the interface is applied to model the purchase decision process, which is an interdisciplinary study, where data collected with the developed interface and subjected to machine learning are combined to model and analyze the decision and roles in a purchasing process. Finally, more generally, the developed system presents a contribution to the field of human-computer interaction and shows further possibilities for scientific use and applications, such as open problem of display blindness, development of new interactive methods for broadcasting of relevant content, and quantitative analysis of user behavior.

Actions (login required)