|
The
Spoken Language User Interface (SLUI) Toolkit is a suite of applications
and tools that allow programmers to develop SLUI-enabled applications.
Using the Toolkit, a SLUI can be incorporated into a new or existing
program.
The
Programmer, the SLUI-Enabled Application, and the End User are the
three basic members of the system. The diagram below describes the
process of creating a SLUI-enabled application, and describes how
the Programmer and End User interact with it.
|
Programmer
The programmer uses the SLUI Toolkit and either C++
or Java to create a SLUI-enabled application. In other
words, the programmer writes the code for the program
and supplies the SLUI Toolkit with the setup information.
SLUI-Enabled
Application
The function of the SLUI is to process an NL sentence
from the End User and match it with a semantically
equivalent sentence that the programmer has previously
supplied. The program will then execute the code that
is linked to the equivalent sentence. A SLUI-enabled
application facilitates communication between the
End User and the Program through the SLUI.
End User
The End User interacts with the program through the
SLUI. The Spoken Language input from the end user
is translated into an action code and passed to the
program. The program then executes the code linked
to the action code and returns the output to the End
User. The End User also interacts directly with the
SLUI through a series of dialog boxes to clarify ambiguous
sentences.
|
|
Why
is the Toolkit needed?
Voice
recognition programs are based on a direct translation between the
speech input and a specific expected word or phrase. Systems need
to be developed that recognize phrase variants.
What
does the Toolkit do?
The SLUI Toolkit assists programmers in creating SLUI-enabled applications
that recognize domain specific NL input. This input includes a range
of WH-queries, yes/no questions, and simple command and control
statements. Essentially, The SLUI Toolkit creates a channel of communication
between the user and a program.
The
Toolkit handles syntax and semantic processing with minimal direction
from the programmer, and removes the need for an in depth understanding
of linguistics (although basic understanding of English grammar
is helpful). By using the SLUI Toolkit, a programmer is able to
create a system that incorporates Natural Language Processing (NLP),
which includes complex syntactic parsing, and semantic understanding..
How does the Toolkit work?
The Toolkit creates a SLUI by using NLP to generate semantic representations
of input sentences provided by the programmer.
The
Toolkit expands these representations using synonym sets and other
linguistic devices, and stores them in a Semantic Frame Table (SFT).
The SFT becomes a comprehensive database of all the possible commands
a user could request a system to do.
The
programmer
uses the Toolkit to create functions for attaching the SLUI to a
program.
The
SLUI-enabled application is then ready for release. A user enters
a NL sentence, the sentence is translated into a semantic frame,
and the SFT is searched for an equivalent frame. If a match is found,
the program executes the action linked to this frame.
Home
: Contact
Us
|