W3C MMI
The Multimodal Interaction Activity is an initiative from W3C aiming to provide means to support Multimodal interaction scenarios on the Web.
This activity was launched in 2002. The Multimodal Interaction Framework Working group has already produced :
- the Multimodal Interaction Framework, providing a general framework for multimodal interaction, and the kinds of markup languages being considered.
- A set of use cases.
- A set of core requirements, which describes the fundamental requirements to address in the future specifications.
Current work
The following XML specifications are already addressing various parts of the Core Requirements :EMMA : a data exchange format for the interface between input processors and interaction management systems. It will define the means for recognizers to annotate application specific data with information such as confidence scores, time stamps, input mode, alternative recognition hypotheses, and partial recognition results etc.InkML – an XML language for digital ink traces: an XML data exchange format for ink entered with an electronic pen or stylus as part of a multimodal system.Multimodal architecture: A loosely coupled architecture for the multimodal interaction framework that focuses on providing a general means for components to communicate with each other, plus basic infrastructure for application control and platform services.- Emotion Markup Language: EmotionML will provide representations of emotions and related states for technological applications.
Useful Links
- on IBM DeveloperWorks