AFastColorInformationSetupUsingEP-LikePSOforManipulatorGraspingColorObjects
Tzuu-HsengS.Li,Member,IEEE,Yin-HaoWang,Ching-ChangChen,andChih-JuiLin
Abstract—Afastcolorinformationsetupbasedonevolutionaryprogramming(EP)likeparticlesswarmoptimization(EPSO)forthemanipulatorcontrolsystemisexaminedinthispaper.The rststepforamanipulatortograspandplacecolorobjectsintothecorrectlocationistocorrectlyidentifytheRGBorthecorrespondinghue,saturation,value(HSV)colormodel.ThecommonlyusedmethodtodeterminethethresholdsofHSVrangeismanualtuning,butitistime-consumingto ndthebestboundarytosegmentthecolorimage.Thispaperproposesanewmethodtolearncolorinformation,whichisexecutedbysemiau-tomaticlearning.At rst,thewatershedalgorithmincorporatesuserinteractionstosegmentthecolorimageandobtainthetargetimage.Then,thecomparisonbetweenthetargetimageandtheoriginalimageisutilizedtobuildalookuptable(LUT)ofcolorinformation,wherethreeHSVthresholdsarelearnedbyPSOmethods.Becausetheconvergencespeedofwell-knownPSOalgorithmsisslowandmaybestuckinthelocalminimum,wepresenttheEPSOmethodrealizedbyapplyingEPtothePSOmethod.Moreover,anovelapproachisinvestigatedtoescapethelocalminimumsupposingtheparticlesarestuckinthelocalminimum.Finally,boththenumericalandexperimentalresultsdemonstratethatthedevelopedapproachcannotonlyrapidlylearnthethresholdstosegmentacolorimagebutcanalsojumpoutthelocalminimum.
IndexTerms—Colorinformation,EPSO,hue,saturation,value(HSV),imagesegmentation,particleswarmoptimization(PSO).
I.INTRODUCTION
M
ANIPULATORShavebeenextensivelystudiedoverthepasttenyears,andalongwiththeimprovementand
evolutionoftechnology,theautomaticmanipulatorisimple-mentedbyaddingsensoryandvisualfeedbackwithacontrolstrategy.Thus,manyroboticresearchesintegratedwithavisualsystemhavebeendevelopedoveralongperiodoftime.Forinstance,thevisualservoingcontrolstherobotbycombiningeye-to-handoreye-in-handmethodology[1],andamanipulatorwithvisualfeedbackiscalledtheeye-to-handcooperation.
ManuscriptreceivedApril24,2013;revisedJuly21,2013;acceptedAu-gust19,2013.DateofpublicationAugust29,2013;dateofcurrentversionDecember12,2014.ThisworkwassupportedinpartbytheMinistryofEducation,Taiwan,andinpartbytheNationalScienceCouncilofTaiwanunderGrantNSC101-2221-E-006-193-MY3.TheaimfortheTopUniver-sityProjecttotheNationalChengKungUniversity(NCKU).Paperno.TII-13-0218.(Correspondingauthor:T.-H.S.Li.)
TheauthorsarewiththeaiRobotsLaboratory,DepartmentofElectricalEngineering,NationalChengKungUniversity,Tainan701,Taiwan(e-mail:thsli@mail.ncku.edu.tw;frog1690@gmail.com;Daniel_chen@itri.org.tw;lirere0225@hotmail.com)
Colorversionsofoneormoreofthe guresinthispaperareavailableonlineatdoc.guandang.net.
Amanipulatorperformingareal-timevisualcontrolstrategyforeye-to-handcoordinationintherealworldwasproposedin[2].Reference[3]developedacalibrationalgorithmforaneye-to-handsystem,whichcansimultaneouslyaccomplishcameracalibration,hand-eyecalibration,andcoordinationoftheworkingplanerelatedtotherobotbaseframe.Also,Chang[4]proposedanimage-basedcontrolstrategyforthevisualservoingofarigidroboticmanipulatorineye-to-handcon guration,wheretheroboticend-effectorwaspreciselymovedtoavisualdeterminedtargetposition.
Inordertoimplementaneye-to-handcooperationsystem,theimageprocessingshouldbeprocessedinreal-timeandbeac-curate.Therefore,theaimofthisstudyisto ndouthowtosegmentacolorimageinreal-timeforavisionsystem.Imagesegmentationisimportantinimageprocessing,whoseintentistoseparatethedesiredobjectsfromthecomplexbackground.Ingeneral,itisveryhardtofullyautomaticallysegmentcolorandtextureinanaturalimage[5].Hence,therearesomesemi-automaticsegmentationmethodsusedbyincorporatinguserin-teractionsthathavebeenproposedin[5]–[12],andtheseap-proachesarebecomingmoreandmorepopular.In[5],thein-teractiveregionmergingmethodisbasedontheinitialsegmen-tationofmeanshift,whichisinputtedbytheusertoroughlyindicatethepositionandmainfeatureoftheobjectbackground.In[7],theuserhastodragarectanglelooselyaroundtheob-ject,andthentheobjectwillbeextractedautomatically.[8]pro-posedalinearprogramming(LP)approachforsegmentingacolorimageintomultipleregions,whereuseralsohastodragsomespeci edstrokestobuildtheGaussianMixtureModel(GMM)fortheforegroundandthebackground.Xiangetal.[11]submittedagraph-basedclassi cationalgorithmforinter-activeimagesegmentation,whichwasdevelopedwithmultiplelinearreconstructionsinimagewindows.Also,theusershoulddragasmallnumberofspeci edstrokes.
Besides,somestudiesutilizedthecolorinformationtosegmenttheimage[13]–[22].Forinstance,theauthorsin[13]usedskincolorinformationandtherestrictedCoulombenergyneuralnetworktotraintheskincolordistributionforahandimage.KjeldsenandKender[14]presentedthetechniquesthatwereutilizedtoseparatethehandimageinagesturerecognitionsystem,andthetargetcolorswereidenti edusingahistogram-likestructure.Reference[16]proposedacom-putationalmodelforgestalt-basedsegmentation,whichreliedonfeaturesmutuallysupportingorinhibitingeachothertosegmentaction.ForRoboCupcompetition,theauthorsin[19]proposedanadaptivecolorcalibrationbasedontheBayesTheoremandchrominancehistograms.[18]controlleda5
Information Products Instruments PCs Electronic ...Using as “Inspection Equipment” at back-end-...setup with any camera mounting positions Easier &...
digits is set using a single external resistor. ...MAX6955 Drive Capability DISPLAY TYPE Monocolor ...The first byte of information is the command ...
using the PowerCORR corrosion measurement software ...If you have a setup that is to be repeated ...2273 ordering information Software PowerSINE PowerCORR...
SETUP Data Has Its Own 8-Byte FIFO, Simplifying...The MAX3420E operates using a register set ...Information PART TEMP RANGE PINPACKAGE 24 TQFN-EP...
digits is set using a single external resistor. ...Information PART MAX6955AAX TEMP RANGE -40°C to...MAX6955 Drive Capability DISPLAY TYPE Monocolor ...
A statistical background model is first setup in ...Edge information can be used to restore the body...background subtraction method using RGB color space...
digits is set using a single external resistor. ...Information PART MAX6954AAX MAX6954APL MAX6954ATL+ ...MAX6954 Drive Capability DISPLAY TYPE Monocolor ...
NOTICE : The information found in this manual is... Color Wheel and Photo Sensor Board Disassemble ...Setup Procedure DDC Key-in Procedure 6-1 6-1 ...
(EP) is empirically observed using three different...For example, in the information engineering ?eld,...Section 3 shows the setup of computer experiments...
热门文档