as soon as brute force search programs like TECH (Gillogly, 1972) and CHESS 4. ..... Past attempts at automatic optimization of search parameters have resulted in limited success. ..... We used the FALCON chess engine in our experiments.
*HQHWLF $OJRULWKPV IRU $XWRPDWLF 6HDUFK 7XQLQJ
*(1(7,& $/*25,7+06 )25 $8720$7,& 6($5&+ 781,1* 2PLG 'DYLG7DELEL
0RVKH .RSSHO
1DWKDQ 6 1HWDQ\DKX
5DPDW*DQ ,VUDHO
$%675$&7 ,Q WKLV SDSHU ZH LQWURGXFH D QRYHO PHWKRG IRU DXWRPDWLFDOO\ WXQLQJ WKH VHDUFK SDUDPHWHUV RI D FKHVV SURJUDP XVLQJ JHQHWLF DOJRULWKPV *$ 2XU UHVXOWV VKRZ WKDW D ODUJH VHW RI SDUDPHWHU YDOXHV FDQ EH OHDUQHG DXWRPDWLFDOO\ VXFK WKDW WKH UHVXOWLQJ SHUIRUPDQFH LV FRPSDUDEOH ZLWK WKDW RI PDQXDOO\ WXQHG SDUDPHWHUV RI WRS WRXUQDPHQWSOD\LQJ FKHVV SURJUDPV
,1752'8&7,21 8QWLO WKH PLG V PRVW FKHVV SURJUDPV DWWHPSWHG WR SHUIRUP VHDUFK E\ PLPLFNLQJ WKH ZD\ KXPDQV WKLQN LH E\ JHQHUDWLQJ ´SODXVLEOHµ PRYHV %\ XVLQJ H[WHQVLYH FKHVV NQRZOHGJH WKHVH SURJUDPV VHOHFWHG DW HDFK QRGH D IHZ PRYHV ZKLFK WKH\ FRQVLGHUHG SODXVLEOH WKHUHE\ SUXQLQJ ODUJH SDUWV RI WKH VHDUFK WUHH +RZHYHU DV VRRQ DV EUXWHIRUFH VHDUFK SURJUDPV OLNH 7 (&+ *LOORJO\ DQG & +(66 ; 6ODWH DQG $WNLQ PDQDJHG WR UHDFK GHSWKV RI SOLHV DQG PRUH SODXVLEOH PRYH JHQHUDWLQJ SURJUDPV IUHTXHQWO\ ORVW WR WKHVH EUXWHIRUFH VHDUFKHUV GXH WR WKHLU VLJQLÀFDQW WDFWLFDO ZHDNQHVVHV %UXWHIRUFH VHDUFKHUV UDSLGO\ GRPLQDWHG WKH FRPSXWHUFKHVV ÀHOG 0RVW EUXWHIRUFH VHDUFKHUV RI WKDW HUD XVHG QR VHOHFWLYLW\ LQ WKHLU IXOOZLGWK VHDUFK WUHH H[FHSW IRU VRPH H[ WHQVLRQV FRQVLVWLQJ PRVWO\ RI FKHFN H[WHQVLRQV DQG UHFDSWXUHV 7KH PRVW VXFFHVVIXO DPRQJ WKHVH EUXWHIRUFH VHDUFKHUV ZHUH % (//( &RQGRQ DQG 7KRPSVRQ ' ((3 7 +28*+7 +VX HW DO WKH SUHGHFHVVRU WR ' ((3 % /8( +DPPLOWRQ DQG *DUEHU +VX ZKLFK ZDV SUREDEO\ WKH ODVW EUXWHIRUFH VHDUFKHU + ,7(&+ %HUOLQHU %HUOLQHU DQG (EHOLQJ (EHOLQJ DQG & 5$< % /,7= +\DWW HW DO 7KH ODWWHU ZDV WKH ÀUVW SURJUDP WKDW PDQDJHG WR FRPSHWH VXFFHVVIXOO\ DJDLQVW KXPDQV 1RZDGD\V WRS WRXUQDPHQWSOD\LQJ SURJUDPV XVH D UDQJH RI PHWKRGV IRU DGGLQJ VHOHFWLYLW\ WR WKHLU VHDUFK 7KH PRVW SRSXODU PHWKRGV LQFOXGH QXOOPRYH SUXQLQJ %HDO 'DYLG7DELEL DQG 1HWDQ\DKX 'RQ QLQJHU IXWLOLW\ SUXQLQJ +HLQ] PXOWLFXW SUXQLQJ %MRUQVVRQ DQG 0DUVODQG DQG VHOHFWLYH H[WHQVLRQV $QDQWKDUDPDQ %HDO DQG 6PLWK )RU HDFK RI WKHVH PHWKRGV D ZLGH UDQJH RI SDUDPHWHU YDOXHV FDQ EH VHW )RU H[DPSOH GLIIHUHQW UHGXFWLRQ YDOXHV FDQ EH XVHG IRU QXOOPRYH SUXQLQJ YDULRXV WKUHVKROGV FDQ EH XVHG IRU IXWLOLW\ SUXQLQJ HWF ,Q WKH IROORZLQJ VHFWLRQ ZH UHYLHZ EULHÁ\ WKH PDLQ PHWKRGV WKDW KDYH EHHQ XVHG IRU VHOHFWLYH VHDUFK )RU HDFK RI WKHVH PHWKRGV ZH HQXPHUDWH WKH SDUDPHWHUV WKDW QHHG WR EH RSWLPL]HG 6HFWLRQ SURYLGHV D UHYLHZ RI SDVW DWWHPSWV DW DXWRPDWLF OHDUQLQJ RI YDULRXV SDUDPHWHUV LQ FKHVV ,Q 6HFWLRQ ZH SUHVHQW RXU DXWRPDWLF PHWKRG RI RSWLPL]LQJ WKH SDUDPHWHUV LQ TXHVWLRQ ZKLFK LV EDVHG RQ WKH XVH RI JHQHWLF DOJRULWKPV *$ DQG LQ 6HFWLRQ ZH SURYLGH H[SHULPHQWDO UHVXOWV 6HFWLRQ FRQWDLQV FRQFOXGLQJ UHPDUNV
6(/(&7,9( 6($5&+ ,1 &+(66 ,Q WKLV VHFWLRQ ZH UHYLHZ VHYHUDO SRSXODU PHWKRGV IRU VHOHFWLYH VHDUFK $OO WKHVH PHWKRGV ZRUN ZLWKLQ WKH DOSKDEHWD396 IUDPHZRUN DQG LQWURGXFH VHOHFWLYLW\ LQ YDULRXV IRUPV $ VLPSOH DOSKDEHWD VHDUFK UHTXLUHV WKH 'HSDUWPHQW RI &RPSXWHU 6FLHQFH %DU,ODQ 8QLYHUVLW\ 5DPDW*DQ ,VUDHO (PDLO PDLO#RPLGGDYLGFRP :HE ZZZRPLGGDYLGFRP 'HSDUWPHQW RI &RPSXWHU 6FLHQFH %DU,ODQ 8QLYHUVLW\ 5DPDW*DQ ,VUDHO (PDLO NRSSHO#FVELXDFLO :HE ZZZFVELXDFLO∼NRSSHO 'HSDUWPHQW RI &RPSXWHU 6FLHQFH %DU,ODQ 8QLYHUVLW\ 5DPDW*DQ ,VUDHO (PDLO QDWKDQ#FVELXDFLO DQG &HQWHU IRU $X WRPDWLRQ 5HVHDUFK 8QLYHUVLW\ RI 0DU\ODQG &ROOHJH 3DUN 0' (PDLO QDWKDQ#FIDUXPGHGX
,&*$ -RXUQDO
-XQH
VHDUFK WUHH WR EH GHYHORSHG WR D À[HG GHSWK LQ HDFK LWHUDWLRQ )RUZDUGSUXQLQJ PHWKRGV VXFK DV QXOOPRYH SUXQLQJ IXWLOLW\ SUXQLQJ DQG PXOWLFXW SUXQLQJ HQDEOH WKH SURJUDP WR SUXQH VRPH SDUWV RI WKH WUHH DW DQ HDUOLHU VWDJH DQG GHYRWH WKH WLPH JDLQHG WR RWKHU PRUH SURPLVLQJ SDUWV RI WKH VHDUFK WUHH ,Q FRQWUDVW VHOHFWLYH H[WHQVLRQV H[WHQG FHUWDLQ SDUWV RI WKH WUHH WR EH VHDUFKHG PRUH GHHSO\ GXH WR WDFWLFDO FRQVLGHUDWLRQV DVVRFLDWHG ZLWK D SRVLWLRQ LQ TXHVWLRQ 7KH IROORZLQJ VXEVHFWLRQV EULHÁ\ FRYHU HDFK RI WKHVH SUXQLQJ PHWKRGV DQG H[WHQVLRQ PHWKRGV DQG VSHFLI\ ZKLFK SDUDPHWHUV VKRXOG EH WXQHG IRU HDFK PHWKRG 1XOO0RYH 3UXQLQJ 1XOOPRYH SUXQLQJ %HDO 'RQQLQJHU 'DYLG7DELEL DQG 1HWDQ\DKX LV EDVHG RQ WKH DV VXPSWLRQ WKDW ´GRLQJ QRWKLQJµ LQ HYHU\ FKHVV SRVLWLRQ LH GRLQJ D QXOOPRYH LV QRW WKH EHVW FKRLFH HYHQ LI LW ZHUH D OHJDO RSWLRQ ,Q RWKHU ZRUGV WKH EHVW PRYH LQ DQ\ SRVLWLRQ KDV WR EH EHWWHU WKDQ WKH QXOOPRYH 7KLV DVVXPSWLRQ HQDEOHV WKH SURJUDP WR HVWDEOLVK D ORZHU ERXQG α RQ WKH SRVLWLRQ E\ FRQGXFWLQJ D QXOOPRYH VHDUFK 7KH LGHD LV WR PDNH D QXOOPRYH LH PHUHO\ VZDS WKH VLGH ZKRVH WXUQ LW LV WR PRYH 1RWH WKDW WKLV FDQQRW EH GRQH LQ SRVLWLRQV ZKHUH WKH VLGH WR PRYH LV LQ FKHFN VLQFH WKH UHVXOWLQJ SRVLWLRQ ZRXOG EH LOOHJDO $OVR WZR QXOOPRYHV LQ D URZ DUH IRUELGGHQ VLQFH WKH\ UHVXOW LQ QRWKLQJ $ UHJXODU VHDUFK LV WKHQ FRQGXFWHG ZLWK UHGXFHG GHSWK R 7KH UHWXUQHG YDOXH RI WKLV VHDUFK FDQ EH WUHDWHG DV D ORZHU ERXQG RQ WKH SR VLWLRQ·V VWUHQJWK VLQFH WKH YDOXH RI WKH EHVW OHJDO PRYH KDV WR EH EHWWHU WKDQ WKDW REWDLQHG IURP WKH QXOOPRYH VHDUFK ,Q D QHJDPD[ IUDPHZRUN LI WKH UHWXUQHG YDOXH LV JUHDWHU WKDQ RU HTXDO WR WKH FXUUHQW XSSHU ERXQG LH value ≥ β LW UHVXOWV LQ D FXWRII IDLOKLJK 2WKHUZLVH LI WKH YDOXH LV JUHDWHU WKDQ WKH FXUUHQW ORZHU ERXQG LH α < value ≤ β ZH GHÀQH D QDUURZHU VHDUFK ZLQGRZ DV WKH UHWXUQHG YDOXH EHFRPHV WKH QHZ ORZHU ERXQG ,I WKH YDOXH LV VPDOOHU WKDQ WKH FXUUHQW ORZHU ERXQG LW GRHV QRW FRQWULEXWH WR WKH VHDUFK LQ DQ\ ZD\ 7KH PDLQ EHQHÀW RI WKH QXOOPRYH FRQFHSW LV WKH SUXQLQJ REWDLQHG GXH WR WKH FXWRIIV ZKLFK WDNH SODFH ZKHQHYHU WKH UHWXUQHG YDOXH RI WKH QXOOPRYH VHDUFK LV JUHDWHU WKDQ WKH FXUUHQW XSSHU ERXQG 7KXV WKH EHVW ZD\ WR DSSO\ QXOOPRYH SUXQLQJ LV E\ FRQGXFWLQJ D PLQLPDOZLQGRZ QXOOPRYH VHDUFK DURXQG WKH FXUUHQW XSSHU ERXQG β VLQFH VXFK D VHDUFK ZLOO UHTXLUH D UHGXFHG VHDUFK HIIRUW WR GHWHUPLQH LI D FXWRII WDNHV SODFH 'RQQLQJHU ZDV WKH ÀUVW WR VXJJHVW DQ DGDSWLYH UDWKHU WKDQ D À[HG YDOXH IRU R ([SHULPHQWV FRQGXFWHG E\ +HLQ] LQ KLV DUWLFOH RQ DGDSWLYH QXOOPRYH SUXQLQJ +HLQ] VKRZHG WKDW LQGHHG DQ DGDSWLYH UDWKHU WKDQ D À[HG YDOXH FRXOG EH VHOHFWHG IRU WKH UHGXFWLRQ IDFWRU %\ XVLQJ R = 3 LQ XSSHU SDUWV RI WKH VHDUFK WUHH DQG R = 2 LQ LWV ORZHU SDUWV FORVH WR WKH OHDYHV SUXQLQJ FDQ EH DFKLHYHG DW D VPDOOHU FRVW DV QXOOPRYH VHDUFKHV ZLOO EH VKDOORZHU LQ FRPSDULVRQ WR XVLQJ D À[HG UHGXFWLRQ YDOXH RI R = 2 ZKLOH PDLQWDLQLQJ WKH RYHUDOO WDFWLFDO VWUHQJWK $ W\SLFDO QXOOPRYH SUXQLQJ LPSOHPHQWDWLRQ LV JLYHQ E\ WKH SVHXGRFRGH LQ )LJXUH $Q LQGHSWK UHYLHZ RI QXOOPRYH SUXQLQJ DQG RXU H[WHQGHG QXOOPRYH UHGXFWLRQV LPSURYHPHQW FDQ EH IRXQG LQ 'DYLG7DELEL DQG 1HWDQ\DKX 2YHU WKH \HDUV PDQ\ YDULDWLRQV RI QXOOPRYH SUXQLQJ KDYH EHHQ VXJJHVWHG EXW WKH VHW RI NH\ SDUDPHWHUV WR EH GHWHUPLQHG KDV UHPDLQHG WKH VDPH 7KHVH SDUDPHWHUV DUH WKH UHGXFWLRQ YDOXH R WKH %RROHDQ DGDSWLYLW\ YDULDEOH DQG WKH DGDSWLYLW\ GHSWK IRU ZKLFK WKH GHFUHPHQWHG YDOXH RI R LV DSSOLHG )XWLOLW\ 3UXQLQJ )XWLOLW\ SUXQLQJ DQG H[WHQGHG IXWLOLW\ SUXQLQJ +HLQ] VXJJHVW SUXQLQJ QRGHV QHDU D OHDI ZKHUH WKH VXP RI WKH FXUUHQW VWDWLF HYDOXDWLRQ YDOXH DQG VRPH WKUHVKROG HJ WKH YDOXH RI D NQLJKW LV VPDOOHU WKDQ α ,Q WKHVH SRVLWLRQV DVVXPLQJ WKDW WKH YDOXH JDLQHG LQ WKH UHPDLQLQJ PRYHV XQWLO UHDFKLQJ WKH OHDI LV QRW JUHDWHU WKDQ WKH WKUHVKROG LW LV VDIH WR DVVXPH WKDW WKH SRVLWLRQ LV ´ZHDN HQRXJKµ LH WKDW LW LV ZRUWK SUXQLQJ DV LWV VFRUH ZLOO QRW EH JUHDWHU WKDQ α 1DWXUDOO\ WKH ODUJHU WKH WKUHVKROG WKH VDIHU LW LV WR DSSO\ IXWLOLW\ SUXQLQJ DOWKRXJK IHZHU QRGHV ZLOO EH SUXQHG $ W\SLFDO IXWLOLW\ SUXQLQJ LPSOHPHQWDWLRQ LV JLYHQ E\ WKH SVHXGRFRGH LQ )LJXUH 7KH PDLQ SDUDPHWHUV WR EH VHW IRU IXWLOLW\ SUXQLQJ DUH WKH IXWLOLW\ GHSWK DQG WKH IXWLOLW\ WKUHVKROGV IRU YDULRXV GHSWKV XVXDOO\ XS WR D GHSWK RI SOLHV
*HQHWLF $OJRULWKPV IRU $XWRPDWLF 6HDUFK 7XQLQJ
#define R 3 GHSWK UHGXFWLRQ YDOXH #define USE ADPT TRUE XVH DGDSWLYLW\ IRU UHGXFWLRQ YDOXH #define ADPT DEPTH 6 DGDSWLYH GHSWK IRU GHFUHPHQWHG UHGXFWLRQ int Search(alpha, beta, depth) { if (depth = beta) { count++; LQFUHPHQW QXPEHU RI FXWRIIV if (count >= MC CUT) return beta; PRYH LV SUXQHG } } } FRQWLQXH UHJXODU DOSKDEHWD396 VHDUFK } )LJXUH 3VHXGRFRGH IRU PXOWLFXW SUXQLQJ 7KH SULPDU\ SDUDPHWHUV WKDW VKRXOG EH VHW LQ PXOWLFXW SUXQLQJ DUH WKH GHSWK UHGXFWLRQ YDOXH WKH GHSWK IRU ZKLFK PXOWLFXW LV DSSOLHG WKH QXPEHU RI PRYHV WR VHDUFK DQG WKH QXPEHU RI FXWRIIV WR UHTXLUH 6HOHFWLYH ([WHQVLRQV 6HOHFWLYH H[WHQVLRQV $QDQWKDUDPDQ %HDO DQG 6PLWK DUH XVHG IRU H[WHQGLQJ SRWHQWLDOO\ FULWLFDO PRYHV WR EH VHDUFKHG PRUH GHHSO\ 7KH IROORZLQJ LV D OLVW RI PDMRU H[WHQVLRQV XVHG LQ PRVW SURJUDPV &KHFN H[WHQVLRQ ([WHQG WKH PRYH LI LW FKHFNV WKH RSSRQHQW·V NLQJ 2QHUHSO\ H[WHQVLRQ ([WHQG WKH PRYH LI LW LV WKH RQO\ OHJDO PRYH 5HFDSWXUH H[WHQVLRQ ([WHQG WKH PRYH LI LW LV D UHFDSWXUH RI D SLHFH FDSWXUHG E\ WKH RSSRQHQW VXFK PRYHV DUH XVXDOO\ IRUFHG 3DVVHG SDZQ H[WHQVLRQ ([WHQG WKH PRYH LI LW LQYROYHV PRYLQJ D SDVVHG SDZQ XVXDOO\ WR WK UDQN 0DWH WKUHDW H[WHQVLRQ ([WHQG WKH PRYH LI WKH QXOOPRYH VHDUFK UHWXUQV D PDWH VFRUH WKH LGHD LV WKDW LI GRLQJ D QXOOPRYH UHVXOWV LQ EHLQJ FKHFNPDWHG D SRWHQWLDO GDQJHU OLHV DW WKH KRUL]RQ VR ZH H[WHQG WKH VHDUFK WR ÀQG WKH WKUHDW )RU HDFK RI WKH DERYH H[WHQVLRQV IUDFWLRQDO H[WHQVLRQV KDYH EHHQ ZLGHO\ HPSOR\HG 7KHVH DUH LPSOHPHQWHG XVXDOO\ E\ GHÀQLQJ RQH SO\ WR EH D QXPEHU JUHDWHU WKDQ RQH HJ SO\ XQLWV VXFK WKDW VHYHUDO IUDFWLRQDO H[WHQVLRQV DORQJ D OLQH LH D VHULHV RI PRYHV IURP WKH URRW WR D OHDI FDXVH D IXOO SO\ H[WHQVLRQ )RU H[DPSOH LI D FHUWDLQ H[WHQVLRQ LV GHÀQHG DV KDOI D SO\ WZR VXFK H[WHQVLRQV PXVW RFFXU DORQJ D OLQH LQ RUGHU WR UHVXOW LQ DQ DFWXDO IXOO SO\ H[WHQVLRQ )RU HDFK H[WHQVLRQ W\SH D YDOXH LV GHÀQHG HJ DVVXPLQJ WKDW SO\ XQLWV DQ H[WHQVLRQ KDV D YDOXH EHWZHHQ WR )URP WKLV EULHI RYHUYLHZ RI VHOHFWLYH VHDUFK WKHUH DUH D QXPEHU RI SDUDPHWHUV IRU HDFK PHWKRG ZKLFK KDYH WR EH VHW DQG WXQHG &XUUHQWO\ WRS WRXUQDPHQWSOD\LQJ SURJUDPV XVH PDQXDOO\ WXQHG YDOXHV ZKLFK WDNH \HDUV
*HQHWLF $OJRULWKPV IRU $XWRPDWLF 6HDUFK 7XQLQJ
RI WULDO DQG LPSURYHPHQW WR ÀQH WXQH ,Q WKH QH[W VHFWLRQ ZH UHYLHZ WKH OLPLWHG VXFFHVV RI SDVW DWWHPSWV DW DXWRPDWLF OHDUQLQJ RI WKH YDOXHV RI WKHVH VHDUFK SDUDPHWHUV DQG LQ 6HFWLRQ ZH SUHVHQW RXU *$EDVHG PHWKRG IRU GRLQJ VR
$8720$7,& 781,1* 2) 6($5&+ 3$5$0(7(56 7KH VHOHFWLYH VHDUFK PHWKRGV FRYHUHG LQ WKH SUHYLRXV VHFWLRQ DUH HPSOR\HG E\ PRVW RI WKH FXUUHQW WRS FKHVV SURJUDPV 7KH\ XVH PDQXDOO\ WXQHG SDUDPHWHU YDOXHV WKDW ZHUH DUULYHG DW DIWHU \HDUV RI H[SHULPHQWV DQG PDQXDO RSWLPL]DWLRQV 3DVW DWWHPSWV DW DXWRPDWLF RSWLPL]DWLRQ RI VHDUFK SDUDPHWHUV KDYH UHVXOWHG LQ OLPLWHG VXFFHVV 0RULDUW\ DQG 0LLNNXODLQHQ XVHG QHXUDO QHWZRUNV IRU WXQLQJ WKH VHDUFK SDUDPHWHUV RI DQ 2WKHOOR SURJUDP EXW DV WKH\ PHQWLRQ LQ WKHLU SDSHU WKHLU PHWKRG LV QRW HDVLO\ DSSOLFDEOH WR PRUH FRPSOH[ JDPHV VXFK DV FKHVV 7HPSRUDO GLIIHUHQFH OHDUQLQJ KDV EHHQ VXFFHVVIXOO\ DSSOLHG LQ EDFNJDPPRQ DQG FKHFNHUV 6FKDHIIHU HW DO 7HVDXUR $OWKRXJK WKH ODWWHU KDV DOVR EHHQ DSSOLHG WR FKHVV %D[WHU HW DO WKH UHVXOWV VKRZ WKDW DIWHU WKUHH GD\V RI OHDUQLQJ WKH SOD\LQJ VWUHQJWK RI WKH SURJUDP ZDV RQO\ (OR ZKLFK LV D YHU\ ORZ UDWLQJ IRU D FKHVV SURJUDP %ORFN HW DO UHSRUWHG WKDW XVLQJ UHLQIRUFHPHQW OHDUQLQJ WKHLU FKHVV SURJUDP DFKLHYHV D SOD\LQJ VWUHQJWK RI RQO\ (OR 9HQHVV HW DO XVHG ERRWVWUDSSLQJ IURP JDPHWUHH VHDUFK WR LPSURYH XSRQ SUHYLRXV ZRUN EXW WKHLU UHVXOWLQJ FKHVV SURJUDP UHDFKHG D SHUIRUPDQFH RI EHWZHHQ WR (OR ZKLFK LV VWLOO FRQVLGHUHG D YHU\ ORZ UDWLQJ IRU D FKHVV SURJUDP 7KH ZRUN E\ .RFVLV DQG 6]HSHVYDUL RQ XQLYHUVDO SDUDPHWHU RSWLPL]DWLRQ LQ JDPHV EDVHG RQ 636$ GRHV QRW SURYLGH DQ\ LPSOHPHQWDWLRQ IRU FKHVV %MRUQVVRQ DQG 0DUVODQG SUHVHQWHG D PHWKRG IRU DXWRPDWLFDOO\ WXQLQJ VHDUFK H[WHQVLRQV LQ FKHVV *LYHQ D VHW RI WHVW SRVLWLRQV IRU ZKLFK WKH FRUUHFW PRYH LV SUHGHWHUPLQHG DQG D VHW RI SDUDPHWHUV WR EH RSWLPL]HG LQ WKHLU FDVH IRXU H[WHQVLRQ SDUDPHWHUV WKH\ WXQH WKH YDOXHV RI WKH SDUDPHWHUV XVLQJ JUDGLHQWGHVFHQW RS WLPL]DWLRQ 7KHLU SURJUDP SURFHVVHV DOO WKH SRVLWLRQV DQG UHFRUGV IRU HDFK SRVLWLRQ WKH QXPEHU RI QRGHV YLVLWHG EHIRUH WKH VROXWLRQ LV IRXQG 7KH JRDO LV WR PLQLPL]H WKH WRWDO QRGH FRXQW RYHU DOO WKH SRVLWLRQV ,Q HDFK LWHUDWLRQ RI WKH RSWLPL]DWLRQ SURFHVV WKHLU PHWKRG PRGLÀHV HDFK RI WKH H[WHQVLRQ SDUDPHWHUV E\ D VPDOO YDOXH DQG UHFRUGV WKH WRWDO QRGH FRXQW RYHU DOO WKH SRVLWLRQV 7KXV JLYHQ N SDUDPHWHUV WR RSWLPL]H HJ N = 4 WKHLU PHWKRG SURFHVVHV LQ HDFK LWHUDWLRQ DOO WKH SRVLWLRQV N WLPHV 7KH SDUDPHWHU YDOXHV DUH XSGDWHG DIWHU HDFK LWHUDWLRQ VR DV WR PLQLPL]H WKH WRWDO QRGH FRXQW %MRUQVVRQ DQG 0DUVODQG DSSOLHG WKHLU PHWKRG IRU WXQLQJ WKH SDUDPHWHU YDOXHV RI WKH IRXU VHDUFK H[WHQVLRQV FKHFN SDVVHG SDZQ UHFDSWXUH DQG RQHUHSO\ H[WHQVLRQV 7KHLU UHVXOWV VKRZHG WKDW WKHLU PHWKRG RSWLPL]HV IUDFWLRQDO SO\ YDOXHV IRU WKH DERYH SDUDPHWHUV DV WKH WRWDO QRGH FRXQW IRU VROYLQJ WKH WHVW VHW LV GHFUHDVHG 'HVSLWH WKH VXFFHVV RI WKLV JUDGLHQWGHVFHQW PHWKRG IRU WXQLQJ WKH SDUDPHWHU YDOXHV RI WKH DERYH IRXU VHDUFK H[WHQVLRQV LW LV GLIÀFXOW WR XVH LW HIÀFLHQWO\ IRU RSWLPL]LQJ D FRQVLGHUDEO\ ODUJHU VHW RI SDUDPHWHUV ZKLFK FRQVLVWV RI DOO WKH VHOHFWLYH VHDUFK SDUDPHWHUV PHQWLRQHG LQ WKH SUHYLRXV VHFWLRQ 7KLV GLIÀFXOW\ LV GXH WR WKH IDFW WKDW XQOLNH WKH RSWLPL]DWLRQ RI VHDUFK H[WHQVLRQV IRU ZKLFK WKH SDUDPHWHU YDOXHV DUH PRVWO\ LQGHSHQGHQW RWKHU VHDUFK PHWKRGV HJ PXOWLFXW SUXQLQJ DUH SURQH WR D KLJK LQWHUGHSHQGHQF\ EHWZHHQ WKH SDUDPHWHU YDOXHV UHVXOWLQJ LQ PXOWLSOH ORFDO PD[LPD LQ WKH VHDUFK VSDFH LQ ZKLFK FDVH LW LV PRUH GLIÀFXOW WR DSSO\ JUDGLHQWGHVFHQW RSWLPL]DWLRQ
*(1(7,& $/*25,7+06 )25 781,1* 2) 6($5&+ 3$5$0(7(56 ,Q WKLV VHFWLRQ ZH SURYLGH IRXU UHDVRQV IRU XVLQJ JHQHWLF DOJRULWKPV IRU WXQLQJ VHDUFK SDUDPHWHUV 7KHQ ZH JLYH D EULHI RYHUYLHZ RI JHQHWLF DOJRULWKPV :H FRQFOXGH E\ SUHVHQWLQJ D *$EDVHG PHWKRG IRU RSWLPL]LQJ D SURJUDPV·V VHDUFK SDUDPHWHUV (YROXWLRQDU\ /HDUQLQJ LQ &KHVV %HORZ ZH SURYLGH IRXU UHDVRQV ZK\ JHQHWLF DOJRULWKPV DUH VXLWDEOH IRU DXWRPDWLF OHDUQLQJ LQ FRPSXWHU FKHVV 7KH VSDFH WR EH VHDUFKHG LV KXJH ,W LV HVWLPDWHG WKDW WKHUH DUH XS WR 10 46 SRVVLEOH SRVLWLRQV WKDW FDQ DULVH LQ FKHVV &KLQFKDONDU $V D UHVXOW DQ\ PHWKRG EDVHG RQ H[KDXVWLYH VHDUFK RI WKH SUREOHP VSDFH LV LQIHDVLEOH
,&*$ -RXUQDO
-XQH
7KH VHDUFK VSDFH LV QRW VPRRWK DQG XQLPRGDO 7KH VHDUFK SDUDPHWHUV RI DQ\ WRS FKHVV SURJUDP DUH KLJKO\ FRGHSHQGHQW )RU H[DPSOH LQ PDQ\ FDVHV LQFUHDVLQJ WKH YDOXHV RI WKUHH SDUDPHWHUV ZLOO UHVXOW LQ D ZRUVH SHUIRUPDQFH EXW LI D IRXUWK SDUDPHWHU LV DOVR LQFUHDVHG WKHQ DQ LPSURYHG RYHUDOO SHUIRUPDQFH ZRXOG EH REWDLQHG 6LQFH WKH VHDUFK VSDFH LV QRW XQLPRGDO LH LW GRHV QRW FRQVLVW RI D VLQJOH VPRRWK ´KLOOµ DQ\ JUDGLHQWDVFHQW DOJRULWKP VXFK DV KLOO FOLPELQJ ZLOO SHUIRUP SRRUO\ ,Q FRQWUDVW JHQHWLF DOJRULWKPV DUH NQRZQ WR SHUIRUP ZHOO LQ ODUJH VHDUFK VSDFHV ZKLFK DUH QRW XQLPRGDO 7KH SUREOHP LV QRW ZHOO XQGHUVWRRG (YHQ WKRXJK DOO WRS SURJUDPV DUH KDQGWXQHG E\ WKHLU SURJUDPPHUV ÀQGLQJ WKH EHVW YDOXH IRU HDFK SDUDPHWHU LV EDVHG PRVWO\ RQ HGXFDWHG JXHVVLQJ DQG LQWXLWLRQ 7KH IDFW WKDW DOO WRS SURJUDPV FRQWLQXH WR RSHUDWH LQ WKLV PDQQHU DWWHVWV WR WKH ODFN RI SUDFWLFDO DOWHUQDWLYHV +DG WKH SUREOHP EHHQ ZHOO XQGHUVWRRG D GRPDLQVSHFLÀF KHXULVWLF ZRXOG KDYH RXWSHUIRUPHG D JHQHUDOSXUSRVH PHWKRG VXFK DV *$ :H GR QRW UHTXLUH D JOREDO RSWLPXP WR EH IRXQG 2XU JRDO LQ WXQLQJ WKH VHOHFWLYH VHDUFK LV WR DGMXVW LWV SDUDPHWHUV VR WKDW WKH RYHUDOO SHUIRUPDQFH RI WKH SURJUDP LV HQKDQFHG ,Q YLHZ RI WKH DERYH SRLQWV LW VHHPV DSSURSULDWH WR HPSOR\ *$ IRU DXWRPDWLF WXQLQJ RI VHDUFK SDUDPHWHUV ,QGHHG DW ÀUVW JODQFH WKLV DSSHDUV OLNH DQ RSWLPL]DWLRQ WDVN ZHOO VXLWHG IRU *$ 7KH YDULRXV SDUDPHWHUV RI VHOHFWLYH VHDUFK FDQ EH HQFRGHG DV D ELWVWULQJ :H FDQ UDQGRPO\ LQLWLDOL]H PDQ\ VXFK ´FKURPRVRPHVµ HDFK UHSUHVHQWLQJ RQH HYDOXDWLRQ IXQFWLRQ 7KHUHDIWHU RQH QHHGV WR HYROYH WKH SRSXODWLRQ XQWLO KLJKO\ WXQHG ´ÀWµ YDOXHV HPHUJH +RZHYHU WKHUH LV RQH PDMRU REVWDFOH WKDW KLQGHUV WKH DERYH DSSOLFDWLRQ RI *$ QDPHO\ WKH ÀWQHVV IXQFWLRQ *LYHQ D VHW RI SDUDPHWHUV YDOXHV HQFRGHG DV D FKURPRVRPH KRZ VKRXOG WKH ÀWQHVV YDOXH EH FDOFXODWHG" )RU PDQ\ \HDUV LW VHHPHG WKDW WKH VROXWLRQ ZDV WR OHW WKH LQGLYLGXDOV DW HDFK JHQHUDWLRQ SOD\ DJDLQVW HDFK RWKHU D VHULHV RI JDPHV DQG VXEVHTXHQWO\ UHFRUG WKH VFRUH RI HDFK LQGLYLGXDO DV LWV ÀWQHVV YDOXH 7KH PDLQ GUDZEDFN RI WKLV DSSURDFK LV WKH XQDFFHSWDEO\ ODUJH DPRXQW RI WLPH QHHGHG WR HYROYH HDFK JHQHUDWLRQ 7KHUH KDYH EHHQ VRPH VXFFHVVIXO DSSOLFDWLRQV RI HYROXWLRQDU\ WHFKQLTXHV LQ FRPSXWHU FKHVV VXEMHFW WR VRPH UHVWULFWLRQV *HQHWLF SURJUDPPLQJ ZDV VXFFHVVIXOO\ HPSOR\HG E\ +DXSWPDQ DQG 6LSSHU IRU HYROYLQJ SURJUDPV WKDW FDQ VROYH 0DWHLQ1 SUREOHPV DQG SOD\ FKHVV HQGJDPHV .HQGDOO DQG :KLWZHOO XVHG HYROXWLRQDU\ DOJRULWKPV IRU WXQLQJ WKH SDUDPHWHUV RI DQ HYDOXDWLRQ IXQFWLRQ 7KHLU DSSURDFK KDG OLPLWHG VXFFHVV GXH WR WKH YHU\ ODUJH QXPEHU RI JDPHV UHTXLUHG DV SUHYLRXVO\ GLVFXVVHG DQG WKH VPDOO QXPEHU RI SDUDPHWHUV XVHG LQ WKHLU HYDOXDWLRQ IXQFWLRQ 7KHLU HYROYHG SURJUDP PDQDJHG WR FRPSHWH ZLWK VWURQJ SURJUDPV RQO\ LI WKHLU VHDUFK GHSWK ORRNDKHDG ZDV VHYHUHO\ OLPLWHG 6LPLODUO\ $NVHQRY XVHG JHQHWLF DOJRULWKPV IRU HYROYLQJ WKH SDUDPHWHUV RI DQ HYDOXDWLRQ IXQFWLRQ XVLQJ JDPHV EHWZHHQ WKH RUJDQLVPV IRU GHWHUPLQLQJ WKHLU ÀWQHVV $JDLQ VLQFH WKLV PHWKRG UHTXLUHG D YHU\ ODUJH DPRXQW RI JDPHV WKH PHWKRG HYROYHG RQO\ D IHZ SDUDPHWHUV RI WKH HYDOXDWLRQ IXQFWLRQ ZLWK OLPLWHG VXFFHVV 7XQVWDOO3HGRH DOVR VXJJHVWHG D VLPLODU DSSURDFK ZLWKRXW SURYLGLQJ DQ LPSOHPHQWDWLRQ ,Q 'DYLG7DELEL HW DO ZH VKRZHG WKDW JHQHWLF DOJRULWKPV *$ FDQ EH XVHG WR HYROYH HIÀFLHQWO\ WKH SDUDPHWHU YDOXHV RI D FKHVV SURJUDP·V HYDOXDWLRQ IXQFWLRQ ,Q VXEVHFWLRQ ZH SUHVHQW D *$ EDVHG PHWKRG IRU RSWLPL]LQJ D SURJUDP·V VHDUFK SDUDPHWHUV %HIRUH WKDW WKH QH[W VXEVHFWLRQ SURYLGHV D EULHI RYHUYLHZ RI JHQHWLF DOJRULWKPV *HQHWLF $OJRULWKPV -RKQ +ROODQG LQYHQWHG JHQHWLF DOJRULWKPV *$ LQ WKH V ,Q KLV ERRN +ROODQG KH SUHVHQWHG *$ DV DQ DEVWUDFWLRQ RI ELRORJLFDO HYROXWLRQ DQG DOVR JDYH D WKHRUHWLFDO DQDO\VLV RI *$ 7KH PDWKHPDWLFDO IRXQ GDWLRQV RI *$ DUH DOVR H[WHQVLYHO\ FRYHUHG DOVR LQ 'DYLG *ROGEHUJ·V ERRN *HQHWLF $OJRULWKPV LQ 6HDUFK 2SWLPL]DWLRQ DQG 0DFKLQH /HDUQLQJ *ROGEHUJ *HQHWLF DOJRULWKPV DUH LPSOHPHQWHG DV D FRPSXWHU VLPXODWLRQ ZKHUH D SRSXODWLRQ RI ´FKURPRVRPHVµ VHUYLQJ DV WKH '1$ RI WKH RUJDQLVP HDFK UHSUHVHQWLQJ RQH SRVVLEOH VROXWLRQ HYROYHV WRZDUGV EHWWHU VROXWLRQV 7KDW LV *$ SURYLGHV DQ HYROXWLRQEDVHG DSSURDFK IRU RSWLPL]DWLRQ 7\SLFDOO\ D UHSUHVHQWDWLRQ RI WKH VROXWLRQ LV HQFRGHG DV D VWULQJ RI ·V DQG ·V WKRXJK RWKHU HQFRGLQJV DUH DOVR SRVVLEOH D ELQDU\ HQFRGLQJ LV XVXDOO\ SUHIHUUHG ZKLFK LV FDOOHG WKH FKURPRVRPH 7KH HYROXWLRQ VWDUWV IURP D SRSXODWLRQ RI UDQGRPO\ JHQHUDWHG LQGLYLGXDOV LH HDFK FKURPRVRPH LV LQLWLDOL]HG ZLWK UDQGRP ELWV ,Q HDFK JHQHUDWLRQ D ÀWQHVV IXQFWLRQ LV DSSOLHG WR HDFK LQGLYLGXDO 7KH KLJKHU WKH ÀWQHVV YDOXH RI WKH LQGLYLGXDO WKH KLJKHU WKH FKDQFHV RI UHSURGXFLQJ LW WKDW LV VXUYLYDO RI WKH ÀWWHVW 7KH QHZO\ FUHDWHG RIIVSULQJ DUH XVHG IRU WKH QH[W JHQHUDWLRQ 7KLV SURFHGXUH LV FRQWLQXHG XQWLO HLWKHU D SUHVSHFLÀHG QXPEHU RI JHQHUDWLRQV LV UHDFKHG RU WKH ÀWQHVV YDOXH RI WKH SRSXODWLRQ RU WKH EHVW LQGLYLGXDO H[FHHGV D SUHGHWHUPLQHG WKUHVKROG
*HQHWLF $OJRULWKPV IRU $XWRPDWLF 6HDUFK 7XQLQJ
,Q RUGHU WR XVH *$ ZH ÀUVW KDYH WR UHSUHVHQW WKH VROXWLRQ GRPDLQ DV DQ HQFRGHG ELQDU\ VWULQJ DQG GHÀQH D ÀWQHVV IXQFWLRQ WR HYDOXDWH HDFK LQGLYLGXDO )LWQHVV )XQFWLRQ 7KH ÀWQHVV IXQFWLRQ LV D SUREOHPGHSHQGHQW IXQFWLRQ WKDW XSRQ UHFHLYLQJ D VROXWLRQ LQ WKH SUREOHP GRPDLQ FKURPRVRPH RI DQ LQGLYLGXDO SURYLGHV D QXPHULF YDOXH UHSUHVHQWLQJ WKH TXDOLW\ RI WKH VROXWLRQ )RU H[DPSOH LQ RSWLPL]DWLRQ SUREOHPV ZKHUH *$ DUH DSSOLHG VXFFHVVIXOO\ WKH ÀWQHVV IXQFWLRQ PHDVXUHV WKH FORVHQHVV RI HDFK VROXWLRQ WR DQ RSWLPXP )RU VRPH SUREOHPV LW LV GLIÀFXOW RU QHDUO\ LPSRVVLEOH WR GHÀQH D ÀWQHVV IXQFWLRQ 7KLV LV WKH PDLQ LPSHGLPHQW WR DSSO\LQJ *$ WR D ZLGHU UDQJH RI SUREOHPV HJ FRPSXWHU FKHVV ,QLWLDOL]DWLRQ ,QLWLDOO\ PDQ\ LQGLYLGXDO VROXWLRQV DUH JHQHUDWHG DW UDQGRP LH HDFK LV LQLWLDOL]HG DV D UDQGRP VWULQJ RI ·V DQG ·V WR IRUP WKH LQLWLDO SRSXODWLRQ 'HSHQGLQJ RQ WKH QDWXUH RI WKH SUREOHP WKH SRSXODWLRQ VL]H W\SLFDOO\ FRQWDLQV VHYHUDO KXQGUHGV RU WKRXVDQGV RI SRVVLEOH VROXWLRQV 6HOHFWLRQ 7KLV RSHUDWRU VHOHFWV FKURPRVRPHV IRU EUHHGLQJ LQ RUGHU WR FUHDWH QHZ RIIVSULQJ WKDW ZLOO VHUYH DV WKH SRSXODWLRQ IRU WKH QH[W JHQHUDWLRQ 7KH ÀWWHU WKH FKURPRVRPH WKH PRUH RIWHQ LW ZLOO EH VHOHFWHG IRU UHSURGXFWLRQ &URVVRYHU 7KLV RSHUDWRU XVHV WKH FKURPRVRPHV RI D SDLU RI SDUHQWV IURP WKH VHOHFWHG SRRO DQG FUHDWHV WZR RIIVSULQJV ,Q VLQJOHSRLQW FURVVRYHU D UDQGRP ORFXV LV FKRVHQ DQG WKH VXEVHTXHQFHV EHIRUH DQG DIWHU WKH ORFXV DUH H[FKDQJHG )RU H[DPSOH DSSO\LQJ FURVVRYHU WR DQG DIWHU WKH ÀIWK ORFXV ZRXOG SURGXFH WKH WZR RIIVSULQJ DQG 7KLV RSHUDWRU PLPLFV WKH ELRORJLFDO UHFRPELQDWLRQ RI WZR KDSORLGV ,Q XQLIRUP FURVVRYHU ZKLFK LV FXUUHQWO\ PRUH SRSXODU IRU HDFK ORFXV D ELW LV UDQGRPO\ FKRVHQ IURP RQH RI WKH SDUHQWV 0XWDWLRQ 7KLV RSHUDWRU UDQGRPO\ ÁLSV VRPH RI WKH ELWV LQ WKH FKURPRVRPHV RI WKH QHZ RIIVSULQJV PLP LFNLQJ WKH ELRORJLFDO PXWDWLRQ ZLWK VPDOO SUREDELOLW\ )RU H[DPSOH PXWDWLQJ WKH VWULQJ LQ LWV WKLUG SRVLWLRQ \LHOGV 7KH DERYH *$ SURFHGXUH LV VXPPDUL]HG LQ )LJXUH 5DQGRPO\ JHQHUDWH n lELW FKURPRVRPHV FDQGLGDWH VROXWLRQV *LYHQ D ÀWQHVV IXQFWLRQ f () HYDOXDWH IRU HDFK FKURPRVRPH x LWV ÀWQHVV YDOXH f (x) ,I D SUHGHÀQHG QXPEHU RI JHQHUDWLRQV LV UHDFKHG RU D ÀWQHVV YDOXH LV VXIÀFLHQWO\ ODUJH WKHQ WHUPLQDWH 2WKHUZLVH UHSHDW WKH IROORZLQJ VWHSV XQWLO n RIIVSULQJ DUH JHQHUDWHG D 6HOHFW D SDLU RI SDUHQWV IURP WKH FXUUHQW SRSXODWLRQ 7KH SUREDELOLW\ RI EHLQJ VHOHFWHG IRU HDFK LQGLYLGXDO LV SURSRUWLRQDO WR LWV ÀWQHVV YDOXH QRWH WKDW HDFK LQGLYLGXDO FDQ EH VHOHFWHG PRUH WKDQ RQFH E :LWK SUREDELOLW\ p c FURVVRYHU SUREDELOLW\ DSSO\ WKH FURVVRYHU RSHUDWRU WR JHQHUDWH WZR RIIVSULQJ ,I QR FURVVRYHU RFFXUV WKH WZR RIIVSULQJ ZLOO EH H[DFW FRSLHV RI WKHLU SDUHQWV F 0XWDWH WKH WZR RIIVSULQJ DW HDFK SRVLWLRQ ZLWK SUREDELOLW\ p m PXWDWLRQ SUREDELOLW\ 5HSODFH WKH ROG SRSXODWLRQ ZLWK WKH QHZO\ JHQHUDWHG SRSXODWLRQ *R WR 6WHS
)LJXUH *HQHWLF DOJRULWKPV SURFHGXUH (YROXWLRQDU\ DOJRULWKPV DUH RQH RI WKH IDVWHVW JURZLQJ ÀHOGV ZLWKLQ $UWLÀFLDO ,QWHOOLJHQFH DQG DUH VXFFHVVIXOO\ DSSOLHG LQ D ZLGH UDQJH RI VFLHQWLÀF DQG HQJLQHHULQJ SUREOHPV VXFK DV RSWLPL]DWLRQ DXWRPDWLF SURJUDPPLQJ PDFKLQH OHDUQLQJ HFRQRPLFV ELRORJ\ DQG PLOLWDU\ DSSOLFDWLRQV *$ IRU 7XQLQJ RI 6HDUFK 3DUDPHWHUV :H QRZ SUHVHQW D *$EDVHG PHWKRG IRU RSWLPL]LQJ D SURJUDP·V VHDUFK SDUDPHWHUV :H ÀUVW GHVFULEH KRZ WKH VHDUFK SDUDPHWHUV DUH UHSUHVHQWHG DV D FKURPRVRPH DQG WKHQ GLVFXVV WKH GHWDLOV RI WKH ÀWQHVV IXQFWLRQ 7KH SDUDPHWHUV RI WKH VHOHFWLYH VHDUFK PHWKRGV ZKLFK ZHUH FRYHUHG LQ 6HFWLRQ FDQ EH UHSUHVHQWHG DV D ELQDU\ FKURPRVRPH ZKHUH WKH QXPEHU RI DOORFDWHG ELWV IRU HDFK SDUDPHWHU LV EDVHG RQ D UHDVRQDEOH YDOXH UDQJH RI
,&*$ -RXUQDO
-XQH
WKH SDUDPHWHU 7DEOH SUHVHQWV WKH FKURPRVRPH DQG WKH UDQJH RI YDOXHV IRU HDFK SDUDPHWHU VHH 6HFWLRQ IRU D GHVFULSWLRQ RI HDFK SDUDPHWHU 1RWH WKDW IRU VHDUFK H[WHQVLRQV IUDFWLRQDO SO\ LV DSSOLHG ZKHUH SO\ = XQLWV HJ DQ H[WHQVLRQ YDOXH RI LV HTXLYDOHQW WR KDOI D SO\ HWF 3DUDPHWHU 1XOOPRYH XVH 1XOOPRYH UHGXFWLRQ 1XOOPRYH XVH DGDSWLYLW\ 1XOOPRYH DGDSWLYLW\ GHSWK )XWLOLW\ GHSWK )XWLOLW\ WKUHVKROG GHSWK )XWLOLW\ WKUHVKROG GHSWK )XWLOLW\ WKUHVKROG GHSWK 0XOWLFXW XVH 0XOWLFXW UHGXFWLRQ 0XOWLFXW GHSWK 0XOWLFXW PRYH QXP 0XOWLFXW FXW QXP &KHFN H[WHQVLRQ 2QHUHSO\ H[WHQVLRQ 5HFDSWXUH H[WHQVLRQ 3DVVHG SDZQ H[WHQVLRQ 0DWH WKUHDW H[WHQVLRQ 7RWDO FKURPRVRPH OHQJWK
9DOXH UDQJH ² ² ² ² ² ² ² ² ² ² ² ² ² ² ² ² ² ²
%LWV
7DEOH &KURPRVRPH UHSUHVHQWDWLRQ RI VHDUFK SDUDPHWHUV OHQJWK ELWV )RU WKH *$·V ÀWQHVV IXQFWLRQ ZH XVH WKH VDPH RSWLPL]DWLRQ JRDO DV WKH RQH XVHG E\ %MRUQVVRQ DQG 0DUVODQG QDPHO\ WKH WRWDO QRGH FRXQW $ VHW RI WDFWLFDO WHVW SRVLWLRQV IURP WKH (QF\FORSHGLD RI &KHVV 0LGGOHJDPHV (&0 LV XVHG IRU WUDLQLQJ SXUSRVHV (DFK RI WKHVH WHVW SRVLWLRQV KDV D SUHGHWHUPLQHG ´FRUUHFW PRYHµ ZKLFK WKH SURJUDP KDV WR ÀQG ,Q HDFK JHQHUDWLRQ HDFK RUJDQLVP VHDUFKHV DOO WKH WHVW SRVLWLRQV DQG UHFHLYHV D ÀWQHVV VFRUH EDVHG RQ LWV SHUIRUPDQFH $V QRWHG LQVWHDG RI XVLQJ WKH QXPEHU RI VROYHG SRVLWLRQV DV D ÀWQHVV VFRUH ZH WDNH WKH QXPEHU RI QRGHV WKH RUJDQLVP YLVLWV EHIRUH ÀQGLQJ WKH FRUUHFW PRYH :H UHFRUG WKLV SDUDPHWHU IRU HDFK SRVLWLRQ DQG FRPSXWH WKH WRWDO QRGH FRXQW IRU HDFK RUJDQLVP RYHU WKH SRVLWLRQV 6LQFH WKH VHDUFK FDQQRW FRQWLQXH HQGOHVVO\ IRU HDFK SRVLWLRQ D PD[LPXP OLPLW RI QRGHV SHU SRVLWLRQ LV LPSRVHG ,I WKH RUJDQLVP GRHV QRW ÀQG WKH FRUUHFW PRYH ZKHQ UHDFKLQJ WKLV PD[LPXP QRGH FRXQW IRU WKH SRVLWLRQ WKH VHDUFK LV VWRSSHG DQG WKH QRGH FRXQW IRU WKH SRVLWLRQ LV VHW WR 1DWXUDOO\ WKH KLJKHU WKH PD[LPXP OLPLW WKH ODUJHU WKH QXPEHU RI VROYHG SRVLWLRQV +RZHYHU PRUH WLPH ZLOO EH VSHQW RQ HDFK SRVLWLRQ DQG VXEVHTXHQWO\ WKH ZKROH HYROXWLRQ SURFHVV ZLOO WDNH PRUH WLPH 7KH ÀWQHVV RI WKH RUJDQLVP ZLOO EH LQYHUVHO\ SURSRUWLRQDWH WR LWV WRWDO QRGH FRXQW IRU DOO WKH SRVLWLRQV 8VLQJ WKLV ÀWQHVV YDOXH UDWKHU WKDQ WKH QXPEHU RI VROYHG SRVLWLRQV KDV WKH EHQHÀW RI GHULYLQJ PRUH ÀWQHVV LQIRUPDWLRQ SHU SRVLWLRQ 5DWKHU WKDQ REWDLQLQJ D ELW LQIRUPDWLRQ IRU VROYLQJ WKH SRVLWLRQ D QXPHULF YDOXH LV REWDLQHG ZKLFK DOVR PHDVXUHV KRZ TXLFNO\ WKH SRVLWLRQ LV VROYHG 7KXV WKH RUJDQLVP LV QRW RQO\ ´HQFRXUDJHGµ WR VROYH PRUH SRVLWLRQV LW LV UHZDUGHG IRU ÀQGLQJ TXLFNHU VROXWLRQV IRU WKH DOUHDG\ VROYHG WHVW SRVLWLRQV 2WKHU WKDQ WKH VSHFLDO ÀWQHVV IXQFWLRQ GHVFULEHG DERYH ZH XVH D VWDQGDUG *$ LPSOHPHQWDWLRQ ZLWK ÀWQHVV SURSRUWLRQDO VHOHFWLRQ XQLIRUP FURVVRYHU DQG HOLWLVP WKH EHVW RUJDQLVP LV FRSLHG WR WKH QH[W JHQHUDWLRQ $OO WKH RUJDQLVPV DUH LQLWLDOL]HG ZLWK UDQGRP YDOXHV 7KH IROORZLQJ SDUDPHWHUV DUH XVHG IRU WKH *$ FRPPRQ YDOXHV IRU FURVVRYHU DQG PXWDWLRQ UDWHV SRSXODWLRQ VL]H FURVVRYHU UDWH PXWDWLRQ UDWH QXPEHU RI JHQHUDWLRQV
7KH QH[W VHFWLRQ FRQWDLQV WKH H[SHULPHQWDO UHVXOWV XVLQJ WKH *$EDVHG PHWKRG IRU RSWLPL]DWLRQ RI WKH VHDUFK SDUDPHWHUV
*HQHWLF $OJRULWKPV IRU $XWRPDWLF 6HDUFK 7XQLQJ
)LJXUH 7RWDO QRGH FRXQW LQ PLOOLRQV IRU WKH (&0 SRVLWLRQV IRU WKH EHVW RUJDQLVP DQG WKH SRSXODWLRQ DYHUDJH LQ HDFK JHQHUDWLRQ WRWDO WLPH IRU JHQHUDWLRQV ≈ KRXUV (;3(5,0(17$/ 5(68/76 :H XVHG WKH )$/&21 FKHVV HQJLQH LQ RXU H[SHULPHQWV )$/&21 LV D JUDQGPDVWHUOHYHO FKHVV SURJUDP ZKLFK KDV VXFFHVVIXOO\ SDUWLFLSDWHG LQ WKUHH :RUOG &RPSXWHU &KHVV &KDPSLRQVKLSV VHFRQG SODFH LQ WKH :RUOG &RPSXWHU 6SHHG &KHVV &KDPSLRQVKLS DQG VL[WK SODFH LQ WKH :RUOG &RPSXWHU &KHVV &KDP SLRQVKLS )$/&21 XVHV 1 (*$ 6 &287396 &DPSEHOO DQG 0DUVODQG 5HLQHIHOG VHDUFK ZLWK QXOOPRYH SUXQLQJ %HDO 'DYLG7DELEL DQG 1HWDQ\DKX 'RQQLQJHU LQWHUQDO LWHUDWLYH GHHS HQLQJ $QDQWKDUDPDQ 6FRWW G\QDPLF PRYH RUGHULQJ KLVWRU\ NLOOHU KHXULVWLF $NO DQG 1HZ ERUQ *LOORJO\ 6FKDHIIHU 6FKDHIIHU PXOWLFXW SUXQLQJ %MRUQVVRQ DQG 0DUVODQG %MRUQVVRQ DQG 0DUVODQG VHOHFWLYH H[WHQVLRQV $QDQWKDUDPDQ %HDO DQG 6PLWK WUDQVSRVLWLRQ WDEOH 1HOVRQ 6ODWH DQG $WNLQ IXWLOLW\ SUXQLQJ QHDU OHDI QRGHV +HLQ] DQG EORFNDJH GHWHFWLRQ LQ HQGJDPHV 'DYLG7DELEL HW DO (DFK RUJDQLVP LV D FRS\ RI )$/&21 LH KDV WKH VDPH HYDOXDWLRQ IXQFWLRQ HWF H[FHSW WKDW LWV VHDUFK SDUDP HWHUV HQFRGHG DV D ELW FKURPRVRPH VHH 7DEOH DUH UDQGRPO\ LQLWLDOL]HG UDWKHU WKDQ PDQXDOO\ WXQHG )LJXUH VKRZV WKH WRWDO QRGH FRXQW IRU WKH SRVLWLRQV IRU WKH EHVW RUJDQLVP DQG WKH SRSXODWLRQ DYHUDJH LQ HDFK JHQHUDWLRQ 7KH UHVXOWV LQGLFDWH WKDW WKH WRWDO QRGH FRXQW IRU WKH SRSXODWLRQ DYHUDJH GURSV IURP PLOOLRQ QRGHV WR PLOOLRQ QRGHV DQG WKH QRGH FRXQW IRU WKH EHVW RUJDQLVP GURSV IURP PLOOLRQ QRGHV WR PLOOLRQ QRGHV 7KH QXPEHU RI VROYHG SRVLWLRQV LQFUHDVHV IURP LQ WKH ÀUVW JHQHUDWLRQ WR LQ WKH WK JHQHUDWLRQ 7DEOH SURYLGHV WKH HYROYHG YDOXHV RI WKH EHVW LQGLYLGXDO 1RWH WKDW IRU ÀYH VHDUFK H[WHQVLRQ SDUDPHWHUV IUDFWLRQDO SOLHV DUH XVHG VXFK WKDW SO\ = XQLWV ZKHUHDV IRU RWKHU SDUDPHWHUV WKH YDOXH LQGLFDWHG LQ WKH WDEOH LV WKH QXPEHU RI IXOO SOLHV )RU H[DPSOH WKH YDOXH IRU ´QXOOPRYH UHGXFWLRQµ SDUDPHWHU LV PHDQLQJ IXOO SOLHV ZKLOH WKH YDOXH RI IRU ´RQHUHSO\ H[WHQVLRQµ SDUDPHWHU LQGLFDWHV D RQH SO\ H[WHQVLRQ VLQFH LQ WKLV FDVH WKH YDOXH RI PHDQV TXDUWHUSOLHV 1RWH WKDW WKH HYROYHG SDUDPHWHU VHW VHH 7DEOH LV QRW QHFHVVDULO\ WKH EHVW SDUDPHWHU VHW IRU HYHU\ FKHVV SURJUDP 8QGRXEWHGO\ UXQQLQJ WKH HYROXWLRQDU\ SURFHVV PHQWLRQHG LQ WKLV SDSHU RQ HDFK FKHVV SURJUDP ZLOO \LHOG D GLIIHUHQW VHW RI UHVXOWV ZKLFK DUH RSWLPL]HG IRU WKH VSHFLÀF FKHVV SURJUDP 7KLV LV GXH WR WKH IDFW WKDW WKH SHUIRUPDQFH RI WKH VHDUFK FRPSRQHQW RI WKH SURJUDP GHSHQGV RQ RWKHU FRPSRQHQWV DV ZHOO PRVW LPSRUWDQWO\ WKH HYDOXDWLRQ IXQFWLRQ )RU H[DPSOH LQ D SUHYLRXV SDSHU RQ H[WHQGHG QXOOPRYH SUXQLQJ 'DYLG7DELEL DQG 1HWDQ\DKX ZH GLVFRYHUHG WKDW ZKLOH WKH FRPPRQ UHGXFWLRQ YDOXH IRU QXOOPRYH SUXQLQJ LV R = 2 RU R = 3 D PRUH DJJUHVVLYH UHGXFWLRQ YDOXH RI DGDSWLYH R = 3 ∼ 4 SHUIRUPV EHWWHU IRU )$/&21 ,W LV LQWHUHVWLQJ WR QRWH WKDW RXU *$EDVHG PHWKRG PDQDJHG WR ÀQG LQGHSHQGHQWO\ WKDW WKHVH DJJUHVVLYH UHGXFWLRQ YDOXHV ZRUN EHWWHU IRU )$/&21 VHH 7DEOH 7R PHDVXUH WKH SHUIRUPDQFH RI WKH EHVW HYROYHG RUJDQLVP ZH FDOO WKLV RUJDQLVP ( 92/ ZH FRPSDUHG LW DJDLQVW WKH FKHVV SURJUDP & 5$)7< +\DWW *RZHU DQG 1HOVRQ & 5$)7< KDV VXFFHVVIXOO\ SDUWLFLSDWHG LQ QXPHURXV :RUOG &RPSXWHU &KHVV &KDPSLRQVKLSV :&&& DQG LV D GLUHFW GHVFHQGHQW RI & 5$< % /,7= WKH :&&& ZLQQHU RI DQG ,W LV IUHTXHQWO\ XVHG LQ WKH OLWHUDWXUH DV D VWDQGDUG UHIHUHQFH
,&*$ -RXUQDO
3DUDPHWHU 1XOOPRYH XVH 1XOOPRYH UHGXFWLRQ 1XOOPRYH XVH DGDSWLYLW\ 1XOOPRYH DGDSWLYLW\ GHSWK )XWLOLW\ GHSWK )XWLOLW\ WKUHVKROG GHSWK )XWLOLW\ WKUHVKROG GHSWK )XWLOLW\ WKUHVKROG GHSWK 0XOWLFXW XVH 0XOWLFXW UHGXFWLRQ 0XOWLFXW GHSWK 0XOWLFXW PRYH QXP 0XOWLFXW FXW QXP &KHFN H[WHQVLRQ 2QHUHSO\ H[WHQVLRQ 5HFDSWXUH H[WHQVLRQ 3DVVHG SDZQ H[WHQVLRQ 0DWH WKUHDW H[WHQVLRQ
/HDUQHG YDOXH
-XQH
8QLW %RROHDQ SOLHV %RROHDQ SOLHV SOLHV FHQWLSDZQV FHQWLSDZQV FHQWLSDZQV %RROHDQ SOLHV SOLHV QXPEHU RI PRYHV QXPEHU RI PRYHV TXDUWHUSOLHV TXDUWHUSOLHV TXDUWHUSOLHV TXDUWHUSOLHV TXDUWHUSOLHV
7DEOH /HDUQHG YDOXHV IRU VHDUFK SDUDPHWHUV )LUVW ZH OHW ( 92/ & 5$)7
