A Simple Diversity Guided Particle Swarm Optimization

Download PDF
0 downloads 0 Views 266KB Size Report
Comment
[2] M.P. Follet, in: P.Graham (Ed.), Mary Parker Follett, “Prophet of. Management: A celebrations of writings from 19205,” Harvard. Business School Press, Bosten ...
 

$6LPSOH'LYHUVLW\*XLGHG3DUWLFOH6ZDUP2SWLPL]DWLRQ 03DQW7 5DGKDDQG9 3 6LQJK FDOOHGWKHSKDVHRISRVLWLYHFRQIOLFWZKLFKLVDFRPELQDWLRQ RIDWWUDFWLRQDQGUHSXOVLRQ7KLVSKDVHLVDFWLYDWHGZKHQWKH VZDUP GLYHUVLW\ LV O\LQJ EHWZHHQ GORZ DQG GKLJK 7KH UHPDLQLQJ SDSHU LV RUJDQL]HG DV IROORZV LQ VHFWLRQ ,, ZH KDYH EULHIO\ GHVFULEHG WKH %DVLF 3DUWLFOH 2SWLPL]DWLRQ %362  $5362 DQG $75(362 LQ VHFWLRQ ,,, WKH H[SHULPHQWDO VHWXS SDUDPHWHU VHWWLQJV DQG EHQFKPDUN SUREOHPVDUHUHSRUWHG7KHH[SHULPHQWDOUHVXOWVDUHDQDO\]HG LQVHFWLRQ,9ILQDOO\WKHSDSHUFRQFOXGHVZLWK6HFWLRQ9



$EVWUDFW²,QWKLVSDSHUZHKDYHSURSRVHGDQHZGLYHUVLW\ JXLGHG3DUWLFOH 6ZDUP2SWLPL]HU 362  QDPHO\ $75(362 ZKLFK LV D PRGLILFDWLRQ RI DWWUDFWLYH DQG UHSXOVLYH 362 $5362  VXJJHVWHG E\ 5LJHW DQG 9HVWHUVWRUP >@ 'HSHQGLQJ RQ WKH GLYHUVLW\ RI WKH SRSXODWLRQ WKH $75(362 VZLWFKHV DOWHUQDWHO\EHWZHHQWKUHHSKDVHVRIDWWUDFWLRQUHSXOVLRQDQGD FRPELQDWLRQ RI DWWUDFWLRQ DQG UHSXOVLRQ FDOOHG WKH SKDVH RI SRVLWLYH FRQIOLFW >@ 7KH SHUIRUPDQFH RI $75(362 LV FRPSDUHGZLWK%DVLF362 %362 DQG$53627KHQXPHULFDO UHVXOWV VKRZ WKDW EHVLGHV SUHVHUYLQJ WKH UDSLG FRQYHUJHQFH RI WKH %362 $75(362 DOVR PDLQWDLQV D JRRG GLYHUVLW\ LQ WKH SRSXODWLRQ8QGHUPRVWRIWKHWHVWFDVHVVLPXODWLRQVVKRZWKDW $75(362 ILQGV D EHWWHU VROXWLRQ WKDQ %362 DV ZHOO DV $5362

3

,, 3$57,&/(6:$50237,0,=$7,21 $ %DVLF3DUWLFOH6ZDUP2SWLPL]DWLRQ %362  3DUWLFOH6ZDUP2SWLPL]DWLRQ 362 LVDUHODWLYHO\QHZHU DGGLWLRQWRDFODVVRISRSXODWLRQEDVHGVHDUFKWHFKQLTXHIRU VROYLQJ QXPHULFDO RSWLPL]DWLRQ SUREOHPV ,WV PHFKDQLVP LV LQVSLUHG IURP WKH FRPSOH[ VRFLDO EHKDYLRU VKRZQ E\ WKH QDWXUDO VSHFLHV OLNH IORFN RI ELUGV VFKRRO RI ILVK DQG HYHQ FURZG RI KXPDQ EHLQJV 7KH SDUWLFOHV RU PHPEHUV RI WKH VZDUPIO\WKURXJKDPXOWLGLPHQVLRQDOVHDUFKVSDFHORRNLQJ IRU D SRWHQWLDO VROXWLRQ (DFK SDUWLFOHDGMXVWV LWV SRVLWLRQ LQ WKH VHDUFK VSDFH IURP WLPH WR WLPH DFFRUGLQJ WR WKH IO\LQJ H[SHULHQFHRILWVRZQDQGRILWVQHLJKERUV RUFROOHDJXHV  )RU D 'GLPHQVLRQDO VHDUFK VSDFH WKH SRVLWLRQ RI WKH LWK SDUWLFOHLVUHSUHVHQWHGDV;L  [L[L«[L' (DFKSDUWLFOH PDLQWDLQV D PHPRU\ RI LWV SUHYLRXV EHVW SRVLWLRQ 3L  SL SL« SL'  DQG D YHORFLW\ 9L  YL YL « YL'  DORQJ HDFK GLPHQVLRQ,QHDFKLWHUDWLRQWKH3YHFWRURIWKHSDUWLFOHZLWK EHVWILWQHVVLQWKHORFDOQHLJKERUKRRGGHVLJQDWHGJDQGWKH 3 YHFWRU RI WKH FXUUHQW SDUWLFOH DUH FRPELQHG WR DGMXVW WKH YHORFLW\ DORQJ HDFK GLPHQVLRQ DQG D QHZ SRVLWLRQ RI WKH SDUWLFOH LV GHWHUPLQHG XVLQJ WKDW YHORFLW\ 7KH WZR EDVLF HTXDWLRQV ZKLFK JRYHUQ WKH ZRUNLQJ RI 362 DUH WKDW RI YHORFLW\YHFWRUDQGSRVLWLRQYHFWRUJLYHQE\ YLG = ZYLG + FU SLG − [LG + F  U S JG − [LG    

, ,1752'8&7,21

$57,&/(VZDUPRSWLPL]DWLRQWHFKQLTXHLVDSRSXODWLRQ EDVHG VWRFKDVWLF VHDUFK WHFKQLTXH ILUVW VXJJHVWHG E\ .HQQHG\DQG(EHUKDUWLQ>@6LQFHWKHQLWKDVEHHQ XVHG WR VROYH D YDULHW\ RI RSWLPL]DWLRQ SUREOHPV ,WV SHUIRUPDQFH KDV EHHQ FRPSDUHG ZLWK PDQ\ SRSXODU VWRFKDVWLF VHDUFK WHFKQLTXHV OLNH *HQHWLF DOJRULWKPV 'LIIHUHQWLDO (YROXWLRQ 6LPXODWHG $QQHDOLQJ HWF >@ >@ >@ $OWKRXJK 362 KDV VKRZQ D YHU\ JRRG SHUIRUPDQFH LQ VROYLQJPDQ\WHVWDVZHOODVUHDOOLIHRSWLPL]DWLRQSUREOHPV LW VXIIHUV IURP WKH SUREOHP RI SUHPDWXUH FRQYHUJHQFH OLNH PRVWRIWKHVWRFKDVWLFVHDUFKWHFKQLTXHVSDUWLFXODUO\LQFDVH RIPXOWLPRGDORSWLPL]DWLRQSUREOHPV 7KH FXUVH RI SUHPDWXUH FRQYHUJHQFH JUHDWO\ DIIHFWV WKH SHUIRUPDQFH RI DOJRULWKP DQG PDQ\ WLPHV OHDG WR D VXE RSWLPDO VROXWLRQ $LPLQJ DW WKLV VKRUWFRPLQJ RI 362 DOJRULWKPVPDQ\YDULDWLRQVKDYHEHHQGHYHORSHGWRLPSURYH LWVSHUIRUPDQFH6RPHRIWKHVHPHWKRGVLQFOXGHIX]]\ 362 >@ K\EULG 362 >@ LQWHOOLJHQW 362   >@ DGGLWLRQ RI D TXHHQSDUWLFOH>@HWF ,Q WKLV SDSHU ZH SUHVHQW D VLPSOH DQG HIIHFWLYH 362 FDOOHG $75(362 ZKLFK LV D YDULDWLRQ RI $5362 D GLYHUVLW\ JXLGHG 362 GHYHORSHG E\ 5LJHW DQG 9HVWHUVWRUP /LNH $5362 $75(362 XVHV GLYHUVLW\ DV D PHDVXUH WR JXLGH WKH VZDUP SRSXODWLRQ ,Q $5362 LI WKH GLYHUVLW\ LV DERYH WKH FHUWDLQ WKUHVKROG GKLJK WKHQ SDUWLFOHV DWWUDFW HDFK RWKHU DQG LI LW LV EHORZ GORZ WKHQ WKH SDUWLFOHV UHSHO HDFK RWKHUXQWLOWKH\PHHWWKHUHTXLUHGKLJKGLYHUVLW\G KLJK,QRXU PRGLILHG YHUVLRQ ZH KDYH VXJJHVWHG DQ LQ EHWZHHQ SKDVH

[LG = [LG + YLG  

  03DQWLVZLWKWKH'HSDUWPHQWRI3DSHU7HFKQRORJ\,QGLDQ,QVWLWXWHRI 7HFKQRORJ\ 5RRUNHH 6DKDUDQSXU &DPSXV  6DKDUDQSXU ±  ,QGLD HPDLOPLOOLISW#LLWUHUQHWLQ  75DGKDLVZLWKWKH'HSDUWPHQWRI3DSHU7HFKQRORJ\,QGLDQ,QVWLWXWHRI 7HFKQRORJ\ 5RRUNHH 6DKDUDQSXU &DPSXV  6DKDUDQSXU ±  ,QGLD HPDLOUDGKDGSW#LLWUHUQHWLQ  936LQJKLV ZLWKWKH'HSDUWPHQWRI 3DSHU7HFKQRORJ\,QGLDQ,QVWLWXWH RI 7HFKQRORJ\ 5RRUNHH 6DKDUDQSXU &DPSXV  6DKDUDQSXU ±  ,QGLD HPDLOVLQJKYS#\DKRRFRLQ 

7KHILUVWSDUWRIHTXDWLRQ  UHSUHVHQWVWKHLQHUWLDRIWKH SUHYLRXVYHORFLW\WKHVHFRQGSDUWLVWKHFRJQLWLRQSDUWDQGLW WHOOVXVDERXWWKHSHUVRQDOWKLQNLQJRIWKHSDUWLFOHWKHWKLUG SDUW UHSUHVHQWV WKH FRRSHUDWLRQ DPRQJ SDUWLFOHV DQG LV WKHUHIRUHQDPHGDVWKHVRFLDOFRPSRQHQW>@$FFHOHUDWLRQ FRQVWDQWV F F >@ DQG LQHUWLD ZHLJKW ω >@ DUH WKH SUHGHILQHGE\WKHXVHUDQGU UDUHWKHXQLIRUPO\JHQHUDWHG UDQGRPQXPEHUVLQWKHUDQJHRI>@  % $5362$OJRULWKP 7KH $5362 DOJRULWKP LV GLYHUVLW\ JXLGHG %362 LQ ZKLFK WKH EHKDYLRU RI WKH VZDUP LV FRQWUROOHG DV SHU WKH YDULDWLRQLQGLYHUVLW\7KHVZDUPSRSXODWLRQNHHSVVKXWWOLQJ EHWZHHQWKHSKDVHVRIDWWUDFWLRQDQGUHSXOVLRQDFFRUGLQJWR

3294 c 1-4244-1340-0/07/$25.00 2007 IEEE

  

  WKH LQFUHDVH RU GHFUHDVH LQ GLYHUVLW\ PHDVXUH ,Q WKH DWWUDFWLRQ SKDVH WKH SDUWLFOHV FRPH WRZDUGV HDFK RWKHU IROORZLQJHTXDWLRQ  DVWKH\GRLQ%3627KHPRYHPHQW RISDUWLFOHVWRZDUGVHDFKRWKHUFDXVHVDJUDGXDOGHFUHDVHLQ GLYHUVLW\ RI WKH SRSXODWLRQ :KHQ WKH GLYHUVLW\ EHFRPHV ORZHU WKHQ D FHUWDLQ VSHFLILHG YDOXH GORZ D UHSXOVLRQ SKDVH REWDLQHG E\ LQYHUWLQJ WKH YHORFLW\ XSGDWH IRUPXOD LV DFWLYDWHGDFFRUGLQJWRWKHIROORZLQJHTXDWLRQ YLG = ZYLG − FU SLG − [LG − F  U S JG − [LG    ,QWKLVSKDVHWKHSDUWLFOHVDUHQRORQJHUDWWUDFWHGWRZDUGV HDFKRWKHUEXWPRYHDZD\RUIURPHDFKRWKHU7KLVJHQHUDWHV DSHUWXUEDWLRQLQWKHSRSXODWLRQDQGFDXVHVDQLQFUHDVHLQWKH GLYHUVLW\RIWKHVZDUPSRSXODWLRQ7KHVZDUPSDUWLFOHVVWD\ LQWKLVSKDVHXQWLOWKHGLYHUVLW\UHDFKHVDKLJKHUYDOXHG KLJK $V VRRQ DV WKH GHVLUHG KLJK GLYHUVLW\ GKLJK LV DFKLHYHG WKH VZDUPSDUWLFOHVDJDLQFRPHEDFNWRWKHDWWUDFWLRQSKDVHDQG WKH VDPH SURFHVV FRQWLQXHV LWHUDWLYHO\ XQWLO WKH JOREDO RSWLPXPLVREWDLQHG 

7KHLGHDEHKLQGWKHLQWURGXFWLRQRIWKLUGSKDVHLVWRLPSURYH WKHH[SORULQJDQGH[SORLWLQJFDSDELOLWLHVRI$5362 ,,, (;3(5,0(17$/6(77,1*6 ,QRUGHUWRPDNHDIDLUFRPSDULVRQRI%362$5362DQG $75(362 ZH IL[HG WKH VDPH VHHG IRU UDQGRP QXPEHU JHQHUDWLRQ VR WKDW WKH LQLWLDO VZDUP SRSXODWLRQ LV VDPH IRU DOO WKH WKUHH DOJRULWKPV 7KH QXPEHU RI SDUWLFOHV LQ WKH VZDUP VZDUP VL]H  ZDV  $ OLQHDUO\ GHFUHDVLQJ LQHUWLD ZHLJKW LVXVHG ZKLFK VWDUWVDW DQG HQGV DW  ZLWK WKH XVHU GHILQHG SDUDPHWHUV F  DQG F  7KH GLYHUVLW\ FRQWUROOLQJSDUDPHWHUVGORZ DQGGKLJKZHUHWDNHQDV ±  DQG  UHVSHFWLYHO\ )RU HDFK DOJRULWKP WKH PD[LPXP QXPEHURILWHUDWLRQVDOORZHGZDVVHWWR$WRWDORI UXQV IRU HDFK H[SHULPHQWDO VHWWLQJ ZHUH FRQGXFWHG DQG WKH DYHUDJHILWQHVVRIWKHEHVWVROXWLRQVWKURXJKRXWWKHUXQZDV UHFRUGHG )RU HYDOXDWLQJ WKH PRGLILHG $75(362 ZH XVHG D WHVW VXLWH RI  VWDQGDUG EHQFKPDUN IXQFWLRQV 7KH WHVW VXLWH FRQVLVWVRIDGLYHUVHVHWRISUREOHPVRIGLIIHUHQWGLPHQVLRQV LQFOXGLQJ XQLPRGDO DQG PXOWLPRGDO IXQFWLRQV DQG DOVR D QRLV\ WHVW IXQFWLRQ 7KH GLPHQVLRQV RI WKH SUREOHPV YDU\ IURPWR,Q7DEOHWKHEHQFKPDUNSUREOHPVKDYHEHHQ OLVWHG

& $75(362$9DULDWLRQRI$5362 7KH $75(362 SURSRVHG E\ XV LQ WKLV DUWLFOH LV MXVW D VLPSOHH[WHQVLRQRI$5362ZKHUHZHKDYHDVVXPHGDWKLUG SKDVH ZKLFK ZH FDOO WKH LQ EHWZHHQ SKDVH RU WKH SKDVH RI SRVLWLYH FRQIOLFW ,W LV TXLWH QDWXUDO WR WKLQN WKDW ,9 (;3(5,0(17$/5(68/76 GLYHUVLW\ GORZ DQG GLYHUVLW\! GKLJK PD\QRWEHWKHRQO\ WZR SRVVLELOLWLHV IRU GHFLGLQJ WKH PRYHPHQW RI WKH VZDUP 7KHUHVXOWVRIWKHEHQFKPDUNSUREOHPV I I DUHVKRZQ EXW PDQ\ WLPHV WKH GLYHUVLW\ PD\ OLH LQ EHWZHHQ WKH WZR LQ 7DEOH ,, LQ WHUPV RI PHDQ EHVW ILWQHVV GLYHUVLW\ DQG WKUHVKROG YDOXHV )RUWKLVUHDVRQ ZH GHFLGHG WR LQWURGXFH D VWDQGDUGGHYLDWLRQ)LJVKRZVWKHPHDQEHVWILWQHVVFXUYHV WKLUG SKDVH ZKLFKLV DFWLYDWHG ZKHQ WKH GLYHUVLW\ LV JUHDWHU DQG WKH GLYHUVLW\ FXUYHV IRU VHOHFWHG EHQFKPDUN SUREOHPV WKDQGORZEXWOHVVWKHQGKLJK,Q$75(362LQVWHDGVZLWFKLQJ )XQFWLRQVVWDUWLQJIURPIWRIDUHRIGLPHQVLRQV)RUI EHWZHHQMXVWWKHDWWUDFWLRQDQGWKHUHSXOVLRQSKDVHRQO\WKH $75(362JDYHDEHWWHUUHVXOWWKDQ$5362DQG%362I LV D YHU\ VLPSOH VSKHUH IXQFWLRQ DQG DOO WKH DOJRULWKPV VZDUPHQWHUVWKHWKLUGSKDVHGHILQHGDV YLG = ZYLG + FU SLG − [LG − F U S JG − [LG     FRQYHUJHG WR WKH JOREDO PLQLPXP +RZHYHU $75(362 WRRNVOLJKWO\ORQJHUWLPHWRFRQYHUJH2QIDQGI$75( ,Q WKLV SKDVH WKHUH LV QHLWKHU FRPSOHWH DWWUDFWLRQ QRU D 362 JDYH D EHWWHU SHUIRUPDQFH LQ FRPSDULVRQ WR $5362 FRPSOHWHUHSXOVLRQ7KHLQGLYLGXDOSDUWLFOHLVDWWUDFWHGE\LWV DQG%362)XQFWLRQILVDQRLV\ IXQFWLRQDQGDVH[SHFWHG RZQ SUHYLRXV EHVW SRVLWLRQ SLG DQG LV UHSHOOHG E\ WKH EHVW %362ZDVQRWDVHIILFLHQWDVRWKHUWZR$75(362JDYHD NQRZQSDUWLFOHSRVLWLRQSJG,QWKLVZD\WKHUHLVQHLWKHUWRWDO EHWWHU ILWQHVV IXQFWLRQ YDOXH WKDQ $5362 )RU I DOVR DWWUDFWLRQQRUWRWDOUHSXOVLRQEXWDEDODQFHEHWZHHQWKHWZR $75(362 ZDV EHWWHU WKDQ $5362 DQG %362 )RU VRPH 7KHVZDUPSDUWLFOHVDUHJXLGHGE\WKHIROORZLQJUXOH UHDVRQ %362 RXWSHUIRUPHG WKH RWKHU DOJRULWKPV LQ I EXW IRU I DJDLQ LW ZDV $75(362 ZKLFK ZDV EHWWHU WKDQ ­°ZYLG + FU SLG − [LG + F U S JG − [LG  GLY > G KLJK YLG = ® ZYLG + FU SLG − [LG − F U S JG − [LG  G ORZ < GLY < G KLJK  $5362 DQG %362 )XQFWLRQV I RQZDUGV DUH RI WZR YDULDEOHVSUREOHPVDQGDOOWKHDOJRULWKPVJDYHPRUHRUOHVV °¯ZYLG − FU SLG − [LG − F U S JG − [LG  GLY < G ORZ VLPLODU UHVXOWV %XW WKHUH DOVR LQ VRPH FDVHV $75(362 7KHGLYHUVLW\ GLY PHDVXUHRIWKHVZDUPLVWDNHQDV>@ JDYHDEHWWHUILWQHVVIXQFWLRQYDOXH$OWKRXJKILVNQRZQ  QV Q [ WREHDQRWRULRXVIXQFWLRQEHFDXVHRIWKHSUHVHQFHRIVHYHUDO  'LYHUVLW\ 6 W =    ¦ ¦ [LM W − [ M W  ORFDO DQG JOREDO PLQLPD VXUSULVLQJO\ DOO WKH DOJRULWKPV QV L = M = FRQYHUJHGWRWKHH[DFWJOREDOPLQLPXP ZKHUH 6 LV WKH VZDUPQ V  ¨6 ¨LV WKH VZDUP VL]HQ [ LV WKH 7KH VORZ FRQYHUJHQFH RI $75(362 LQ VRPH FDVHV LV GLPHQVLRQDOLW\RIWKHSUREOHP[LMLVWKHM¶WKYDOXHRIWKHL¶WK TXLWH QDWXUDO DQG H[SHFWHG EHFDXVH RI WKH SUHVHQFH RI DQ DGGLWLRQDOSKDVH+RZHYHUDQRWLFHDEOHWKLQJDERXWLWLVWKH SDUWLFOHDQG [ M W LVWKHDYHUDJHRIWKHMWKGLPHQVLRQRYHU IDFW WKDW LW PDLQWDLQV D KLJK OHYHO RI GLYHUVLW\ ZLWKRXW GLVWXUELQJWKHFRQYHUJHQFH DOOSDUWLFOHVLH  Q V

¦ [ LM W

[ M W =

L =

QV



2007 IEEE Congress on Evolutionary Computation (CEC 2007)

3295

    7$%/(, 180(5,&$/%(1&+0$5.)81&7,216  5(0$5.6)81&7,2166,1($1'&26,1(7$.($5*80(176,15$',$16 7+()81&7,21X86(',1I$1'7+(0$75,;D86(',1I$5($//'(),1(',17+($33(1',; 





  3296

2007 IEEE Congress on Evolutionary Computation (CEC 2007)  

    7$%/(,, 5(68/76)25$//$/*25,7+0621%(1&+0$5.352%/(062)',0(16,21$/,7@ 9HVWHUVWU¡P - 6 5LJHW - DQG .ULQN 7 ³'LYLVLRQ RI /DERU LQ 3DUWLFOH6ZDUP2SWLPLVDWLRQ´,Q3URFHHGLQJVRIWKH)RXUWK&RQJUHVV RQ (YROXWLRQDU\ &RPSXWDWLRQ &(&  YRO   SJ   >@ @ 0/RYHEHUJ7.5DVPXVVHQDQG7NULQN³+\EULG3DUWLFOH 6ZDUP RSWLPL]HU ZLWK %UHHGLQJ DQG VXESRSXODWLRQ´ 3URF RI (YROXWLRQDU\ &RPSXWDWLRQ&RQIHUHQFH6DQ)UDQFLVFR86$ >@ * &LXSULQD ' /RDQ DQG , 0XQWHDQX ³8VH RI ,QWHOOLJHQW 3DUWLFOH 6ZDUP 2SWLPL]DWLRQ LQ (OHFWURPDJQHWLFV´ ,((( 7UDQVDFWLRQV LQ 0$*1(7,&69RO1RSJ± >@ 0 &OHUF ³7KH 6ZDUP DQG WKH 4XHHQ 7RZDUGV D 'HWHUPLQLVWLF DQG $GDSWLYH 3DUWLFOH 6ZDUP 2SWLPL]DWLRQ´ 3URF  &RQJUHVV RQ (YROXWLRQDU\&RPSXWDWLRQ:DVKLQJWRQ'&SJ± >@ .HQQHG\-³7KH3DUWLFOH6ZDUP6RFLDO$GDSWDWLRQRI.QRZOHGJH´ ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ (YROXWLRQDU\ &RPSXWDWLRQ ,QGLDQDSROLV ,QGLDQD  ,((( 6HUYLFH &HQWHU 3LVFDWDZD\ 1-  SJ >@ 5& (EHUKDUW @ 6KL@ $3 (QJHOEUHFKW ³)XQGDPHQWDOV RI &RPSXWDWLRQDO 6ZDUP ,QWHOOLJHQFH´-RKQ:LOH\ 6RQV/WG



2007 IEEE Congress on Evolutionary Computation (CEC 2007)

3299