Worldwide Sites

You have been detected as being from . Where applicable, you can see country-specific product information, offers, and pricing.

Change country/language X

Keyboard ALT + g to toggle grid overlay

Waken: Reverse Engineering Usage Information and Interface Structure from Software Videos

ACM Symposium on User Interface Software & Technology
2012

Waken: Reverse Engineering Usage Information and Interface Structure from Software Videos (5:31 min.)

Video title (x:xx min.)

Abstract

We explore the possibilities and opportunities related to reverse engineering usage information from screen-captured application video tutorials. We develop an application-independent system that recognizes UI components and activities, such as cursor movements and icon clicks, from an input set of video tutorials, We then present Waken, an enhanced video player, which showcases some of the design opportunities the are introduced by having this additional meta-data. In particular, users can directly interact with UI components in the video, such as icons and menus, to display associated information, or navigate to relevant moments in other videos. Initial results suggest that the system can successfully reconstruct many aspects of a UI without any prior application-dependent knowledge.

Related Publications

Related Projects

Software Learning

The Learning project aims to investigate advanced techniques for assisting users in learning complicated applications. We are interested in a range of investigations from the scientific study of the human learning process to prototyping novel interaction techniques for improving the general learning mechanisms that can be applied to all applications.

Heading

Descriptive text. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt magna aliqua in reprehenderit.

Heading

Descriptive text. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt magna aliqua in reprehenderit.