W3C MMI
Encyclopedia
The Multimodal Interaction Activity is an initiative from W3C aiming to provide means (mostly XML
) to support Multimodal interaction
scenarios on the Web
.
This activity was launched in 2002. The Multimodal Interaction Framework Working group
has already produced :
The set of devices that are considered are mobile phone
s, automotive telematics, PC
s connected on the Web
.
specifications (currently in advanced Working draft state) are already addressing various parts of the Core Requirements :
XML
Extensible Markup Language is a set of rules for encoding documents in machine-readable form. It is defined in the XML 1.0 Specification produced by the W3C, and several other related specifications, all gratis open standards....
) to support Multimodal interaction
Multimodal interaction
Multimodal interaction provides the user with multiple modes of interfacing with a system. A multimodal interface provides several distinct tools for input and output of data.- Multimodal input :...
scenarios on the Web
World Wide Web
The World Wide Web is a system of interlinked hypertext documents accessed via the Internet...
.
This activity was launched in 2002. The Multimodal Interaction Framework Working group
Working group
A working group is an interdisciplinary collaboration of researchers working on new research activities that would be difficult to develop under traditional funding mechanisms . The lifespan of the WG can last anywhere between a few months and several years...
has already produced :
- the Multimodal Interaction Framework, providing a general frameworkSoftware frameworkIn computer programming, a software framework is an abstraction in which software providing generic functionality can be selectively changed by user code, thus providing application specific software...
for multimodal interactionMultimodal interactionMultimodal interaction provides the user with multiple modes of interfacing with a system. A multimodal interface provides several distinct tools for input and output of data.- Multimodal input :...
, and the kinds of markup languages being considered. - A set of use caseUse caseIn software engineering and systems engineering, a use case is a description of steps or actions between a user and a software system which leads the user towards something useful...
s. - A set of core requirements, which describes the fundamental requirements to address in the future specifications.
The set of devices that are considered are mobile phone
Mobile phone
A mobile phone is a device which can make and receive telephone calls over a radio link whilst moving around a wide geographic area. It does so by connecting to a cellular network provided by a mobile network operator...
s, automotive telematics, PC
Personal computer
A personal computer is any general-purpose computer whose size, capabilities, and original sales price make it useful for individuals, and which is intended to be operated directly by an end-user with no intervening computer operator...
s connected on the Web
World Wide Web
The World Wide Web is a system of interlinked hypertext documents accessed via the Internet...
.
Current work
The following XMLXML
Extensible Markup Language is a set of rules for encoding documents in machine-readable form. It is defined in the XML 1.0 Specification produced by the W3C, and several other related specifications, all gratis open standards....
specifications (currently in advanced Working draft state) are already addressing various parts of the Core Requirements :
- EMMA (Extensible Multi-Modal Annotations): a data exchange format for the interface between input processors and interaction management systems. It will define the means for recognizers to annotate application specific data with information such as confidence scores, time stamps, input mode (e.g. key strokes, speech or pen), alternative recognition hypotheses, and partial recognition results etc.
- InkMLInkMLInkML is an XML-based markup language to describe "ink" data input with an electronic pen or stylus. The recommended specification was published by the World Wide Web Consortium in September of 2011....
– an XMLXMLExtensible Markup Language is a set of rules for encoding documents in machine-readable form. It is defined in the XML 1.0 Specification produced by the W3C, and several other related specifications, all gratis open standards....
language for digital ink traces: an XML data exchange format for ink entered with an electronic pen or stylus as part of a multimodal system. - Multimodal architecture: A loosely coupled architecture for the multimodal interaction framework that focuses on providing a general means for components to communicate with each other, plus basic infrastructure for application control and platform services.
- Emotion Markup LanguageEmotion Markup LanguageAn Emotion Markup Language has first been defined by the W3C Emotion Incubator Group as a general-purpose emotion annotation and representation language, which should be usable in a large variety of technological contexts where emotions need to be represented...
: EmotionML will provide representations of emotions and related states for technological applications.
See also
- Multimodal InteractionMultimodal interactionMultimodal interaction provides the user with multiple modes of interfacing with a system. A multimodal interface provides several distinct tools for input and output of data.- Multimodal input :...
- VoiceXMLVoiceXMLVoiceXML is the W3C's standard XML format for specifying interactive voice dialogues between a human and a computer. It allows voice applications to be developed and deployed in an analogous way to HTML for visual applications. Just as HTML documents are interpreted by a visual web browser,...
– the W3C's standard XMLXMLExtensible Markup Language is a set of rules for encoding documents in machine-readable form. It is defined in the XML 1.0 Specification produced by the W3C, and several other related specifications, all gratis open standards....
format for specifying interactive voice dialogues between a human and a computer. - SSMLSpeech Synthesis Markup LanguageSpeech Synthesis Markup Language is an XML-based markup language for speech synthesis applications. It is a recommendation of the W3C's voice browser working group. SSML is often embedded in VoiceXML scripts to drive interactive telephony systems. However, it also may be used alone, such as for...
– Speech Synthesis Markup Language - CCXML – Call Control eXtensible Markup Language
- SCXMLSCXMLSCXML stands for State Chart XML: State Machine Notation for Control Abstraction. It is an XML-based markup language which provides a generic state-machine based execution environment based on Harel statecharts.SCXML is able to describe complex state-machines...
– an XML language that provides a generic state-machine based execution environment