“I have always wished that my computer would be as easy to use as my telephone. My wish has come true. I no longer know how to use my telephone.” – Bjarne Stroustrop (originator of C++) As household appliances grow in complexity and sophistication, they
Table 1: The “message_list” table is one of five relations comprising the database that EXACT uses to represent the state of the Panasonic KXTC1040W.
Note that while we have fully implemented the EXACT NLIA, we have tested it on a simulation of the Panasonic device, rather than the actual appliance hardware; we have not done the wiring and tinkering that would be required to actually drive the appliance. Nevertheless, our command set was taken directly from the manual for the appliance [1], so we are confident that our simulation is realistic.
Our expertise is not in speech; hence the focus of this paper is on developing an expressive NLIA as a step towards the ultimate goal of linking it to a speech recognizer.
In contrast with the work of Moore, Allen, and Walker [30, 3, 26], we have not built a full-blown dialog system. Instead, we focus on the core capability of understanding single-sentence appliance commands such as “Cook my corn for 5 minutes” as well as goals such as “Delete my old messages,” which requires a multi-step plan to find each old message and erase it in turn. Thus, our NLIA implements a function from a single English sentence encoding a person’s request to a command sequence that satisfies the request when executed on the appliance. Due to its reliability, we believe that our NLIA would be an attractive module for researchers investigating dialog systems.
While our model is readily extensible to multiple devices in a networked home, we have not yet addressed the issue of identifying which device the user is addressing based on context or content. However, the straightforward approach of explicitly naming a device when addressing it seems reasonable. For example, a person could say “VCR: record Seinfeld.”
Finally, we assume that the NLIA has an accurate behavioral model of the appliances with which it integrates. If exogenous events can affect the device (e.g., an external caller leaving a message), we assume that the device will notify the NLIA of this fact. This assumption is reasonable because all existing devices we surveyed notify the user of exogenous events (e.g., the phone rings, the answering machine displays a count of new messages, and the thermostat display indicates whether the furnace is on or off). While our implemented system depends on this assumption, our overall approach does not. By using a more complex, information-gathering planner such as PUCCINI or XII [9, 10, 11], our NLIA would operate correctly even without notification of these events.
Interpreting a user’s commands is more complex if there are multiple plans being executed at the same time. In this case a user’s command can affect not just the appliance, but also the agent’s execution stack of previously planned actions. Thus, we assume that the NLIA will process new requests only after previously planned actions have been fully executed.
commands to an appliance are made relative to the device’s state, either by querying the state (e.g., “When is the sprinkler system set to water?”) or modifying it (e.g., “Set the thermostat to 68°.”). Since a relational database is a convenient and natural way to conceptualize a device’s state, a user’s command can be modeled with SQL statements, and can be computed using an NLIDB. In order to create a full NLIA, however, we need to show a method for satisfying the SQL query and update statements, using the device’s primitive command set – for this task, we use a planning algorithm. As we argue below, one of the advantages of this approach is the construction of a reliable (i.e., sound and complete) NLIA by exploiting the formal properties of existing NLIDB and planning systems.
Formally, we model an appliance as a pair, <A, DB>, where A is a set of action descriptions in the PDDL planning language [15] and DB is a database representation of the appliance’s initial state. For example, table 1 shows a fragment of a sample relation from the database model of its internal state, and figure 1 shows some sample actions for the Panasonic phone.
Figure 1: PDDL encoding of some Panasonic KXTC1040W actions.
Our NLIA is composed of four parts: the appliance model <A, DB>, an NLIDB, a translation module, and a planner. At run-time, the system takes as input a natural language sentence and feeds it to the NLIDB (figure 2). The NLIDB converts the input to an SQL statement consistent with the schema of database DB. If the SQL denotes a query, it is executed on DB and the result is returned to the user. For example, the English question, “what is the answering machine volume?” is mapped to the following SQL query:
SELECT volume FROM answer_machine
4. NLIA BY REDUCTION
In this section we show how to build an NLIA using an NLIDB and a planner. The reduction is based on the observation that user

A Reliable Natural Langu... 暂无评价 8页 免费 Application of Natural L.... Developing a Natural Language Interface to Complex Data GARY G. HENDRIX, ...
A Natural Language Inter... 暂无评价 4页 免费 A Reliable Natural Langu....Interface to Data management (EUFID) system, a n a t u r a l - l ...
Many of the seniors language has reached a level...interface circuits,to highlingt the target of ...3.In the applicationof household appliances It ...
A visualization of small high-level language ...interface circuits, highlight the object of ... household appliances, medical equipment, aerospace,...
reliable news 新闻/通讯稿 news release 头条新闻 ...interface 无线掌上导航器 wireless palm pilot 蜂窝...household electrical appliances 局域网 Intranet 网站...
Many high-level language has reached the level ...interface circuits, highlight the object of ...In Household Appliances can be said that the ...
Many high-level language has reached the level ..., navigation systems, and household appliances. ...interface circuits, highlight the object of ...
code language, and as so low why is the use?..., navigation systems, and household appliances. ...interface circuits, highlight the object of ...
Many high-level language has reached the level ...interface circuits, highlight the object of ...In Household Appliances can be said that the ...
Many high-level language has reached the level ...interface circuits, highlight the object of ...In Household Appliances Can be said that the ...
热门文档