... of the interaction modality, allowed participants to do more non-instructed (e.g. looking at the surrounding environment) than instructed activities (e.g. focusing on the user interface). user studies sound-based input/output mobile computing multimodal interfaces information architecture We explore...

... exist simultaneously, or be provided separately? How do different menu styles affect the design of shared input multimodal interfaces? The research literature on hierarchical menu layout and on output modality in hierarchical menus is reviewed in the following sections. We begin by reviewing...

... was going on, and you got a response on your own actions. Haptic Audio Multimodal interfaces Collaboration Problem solving One interesting type of gestures that has been shown to be an important aid in the grounding process is deictic references to objects like e.g., “this one”, “the blue block...

... the process definitions. The presented approach can be applied to analyse and compare fusion processes in existing systems, as well as an aid for interface designers, who have to verify the behaviour of their systems. multimodal interfaces fusion formal methods ambiguity Interacting with Computers ml8 no 2...

... Language captions closed captions Facebook Flickr images metadata social media Twitter Wikipedia WordNet CDNS Columbia Digital News System iMOD ROCCO II summarization videogames multimodal interfaces human–computer interfaces multimodal grammar multimodal reference expressions embodied...

... in a number of research and development efforts. This chapter presents examples of the successful implementation of multimodal interfaces in support of concurrent task performance and information processing. It describes additional benefits of distributing information across sensory channels, including...