Interactive textbook and interactive Venn Diagram natural and intuitive interfaces on augme

This paper describes two interface prototypes which we have developed on our augmented desk interface system, EnhancedDesk. The first application is Interactive Textbook, which is aimed at providing an effective learning environment. When a student opens a

InteractiveTextbookandInteractiveVennDiagram:Natural

andIntuitiveInterfacesonAugmentedDeskSystem

HidekiKoike YoichiSato YoshinoriKobayashi

HiroakiTobita GraduateUniversitySchoolofInformation1-5-1,ofElectro-Communications

Systems

TokyoChofugaoka,+81-424-43-5651182-8585,JapanChofukoike@acm.org

ABSTRACT

Thispaperdescribestwointerfaceprototypeswhichwehavedevelopedonouraugmenteddeskinterfacesys-tem,EnhancedDesk.The rstapplicationisInterac-tiveTextbook,whichisaimedatprovidingane ectivelearningenvironment.Whenastudentopensapagewhichdescribesexperimentsorsimulations,InteractiveTextbookautomaticallyretrievesdigitalcontentsfromitsdatabaseandprojectsthemontothedesk.Interac-tiveTextbookalsoallowsthestudenthands-onabilitytointeractwiththedigitalcontents.Thesecondappli-cationistheInteractiveVennDiagram,whichisaimedatsupportinge ectiveinformationretrieval.Insteadofkeywords,thesystemusesrealobjectssuchasbooksorCDsaskeysforretrieval.Thesystemprojectsacirclearoundeachbook;datacorrespondingthebookarethenretrievedandprojectedinsidethecircle.Bymovingtwoormorecirclessothatthecirclesintersecteachother,theusercancomposeaVenndiagraminteractivelyonthedesk.Wealsodescribethenewtechnologiesintro-ducedinEnhancedDeskwhichenableustoimplementtheseapplications.

KEYWORDS:

augmentedreality,computervision, n-ger/handrecognition,informationretrieval,Venndia-gram,education,computersupportedlearning,

INTRODUCTION

OneoftheimportantgoalsinComputerHumanInter-actionsistodevelopmorenaturalandmoreintuitiveinterfaces.Graphicaluserinterface(GUI),whichisacurrentstandardinterfaceonpersonalcomputers(PC-s),iswell-maturedandprovidesane cientinteractionforuserswhohavealreadyhadexperiencewithPCs.However,itisnottruethatGUIalwaysprovidesnaturalandintuitiveinterfaces.Consider,forexample,amouse,

MotokiKobayashi

Institute7-22-1,UniversityofIndustrialofTokyoEngineering

TokyoRoppongi,106-0032,Minato-kuJapanysato@cvl.iis.u-tokyo.ac.jp

+81-3-3401-1433

whichisastandardpointingdeviceinGUI.Eventhoughthemouseenablesrapidandexactpointing,movingthemouseonadeskinordertomoveacursoroncomputerscreendoesnotcomenaturallytohumans.Veryoften,usersexperienceconfusionwhentheyattempttouseamouseforthe rsttime.Toselectanitemfromanitemlistondisplayortopointroughpositionondisplay,itismorenaturalandmoreintuitiveforthemtousetheirindex nger.Thisstatementissupportedbythefactthattherearemanytouchpanelinterfaces(e.g.,ATMs)whichareusedbyordinarypeople.

Therearemanyinformationsystemswhichcanprovidemorenaturalandmoreintuitiveinterfacewhenwere-movetherestrictionsimposedbytheGUI.Forexam-ple,Boltdemonstratede ectivenessofamultimodalinteractionwithgestureandspeechinSDMS[3].Itismainlythehighcostofhardwarealongwithimmaturesensingtechnologythathavepreventedusfromdevel-opingsuchsystems.Nowthecostofhardwarehasbeenreducedandmanysensingtechnologieshavebeendevel-oped.Itistimetodiscussanddevelopalternativein-terfaces.Someresearchershaveproposednewinterfaceframeworks.Forexample,Turk[18]proposedthePer-ceptualUserInterface(PUI)whichusesseveralsensingtechnologiestointeractwithcomputers.Fitzmauriceetal.[4]andIshiietal.[6,7,19,20]proposedtheGras-pable/TangibleInterfacewhichusesrealworldobjectstomanipulatedigitalinformation;thatgroupdevelopedmanyprototypesystems.

Wehavedevelopedanaugmenteddeskinterfacebyus-ingcomputervisionasakeytechnology.Enhanced-Desk[9]isaninfrastructuretodevelopapplicationssup-portingworkintheo ce.EnhancedDeskisin uencedbyWellner’sDigitalDesk[21].Thebasichardwarecon- gurationsuchastheuseofadesk,aCCDcamera,andavideoprojectorissimilartothatofDigitalDesk.However,somenoveltechnologiesareintroducedinEn-hancedDesktoenablemoreadvancedinteraction.Thispaperdescribestwointerfaceprototypesdevelope-donEnhancedDesk.OneistheInteractiveTextbook,