Combining Neural Networks for Arabic Handwriting Recognition

7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R1RYHPEHU

&RPELQLQJ1HXUDO1HWZRUNVIRU$UDELF +DQGZULWLQJ5HFRJQLWLRQ

&KHUJXL/HLOD.HI0DDPDUDQG&KLNKL6DOLP 'HSDUWPHQWRI&RPSXWHU6FLHQFHV8QLYHUVLW\/DUEL%HQ0KLGL$OJHULD 'HSDUWPHQWRI&RPSXWHU6FLHQFHV8QLYHUVLW\+DGM/DNKGDU$OJHULD 'HSDUWPHQWRI&RPSXWHU6FLHQFHV8QLYHUVLW\0HQWRXUL$OJHULD

$EVWUDFW&RPELQLQJFODVVLILHUVLVDQDSSURDFKWKDWKDVEHHQVKRZQWREHXVHIXORQQXPHURXVRFFDVLRQVZKHQVWULYLQJIRU IXUWKHU LPSURYHPHQW RYHU WKH SHUIRUPDQFH RI LQGLYLGXDO FODVVLILHUV ,Q WKLV SDSHU ZH SUHVHQW D 0XOWLSOH &ODVVLILHU 6\VWHP 0&6 IRU RIIOLQH $UDELF KDQGZULWLQJ UHFRJQLWLRQ 7KH 0&6 FRPELQHV WKUHH QHXURQDO UHFRJQLWLRQ V\VWHPV EDVHG RQ )X]]\ $57QHWZRUNXVHGIRUWKHILUVWWLPHLQ$UDELF2&5PXOWLOD\HUSHUFHSWURQDQGUDGLDOEDVLFIXQFWLRQV:HXVHYDULRXVIHDWXUH VHWVEDVHGRQ7FKHELFKHI+XDQG=HUQLNHPRPHQWV)RUGHULYLQJWKHILQDOGHFLVLRQGLIIHUHQWFRPELQLQJVFKHPHVDUHDSSOLHG 7KHEHVWFRPELQDWLRQHQVHPEOHKDVDUHFRJQLWLRQUDWHRIZKLFKLVVLJQLILFDQWO\KLJKHUWKDQWKHDFKLHYHGE\ WKHEHVWLQGLYLGXDOFODVVLILHU7RGHPRQVWUDWHWKHKLJKSHUIRUPDQFHRIWKHFODVVLILFDWLRQV\VWHPWKHUHVXOWVDUHFRPSDUHGZLWK WKUHHUHVHDUFKXVLQJ,)1(1,7GDWDEDVH .H\ZRUGV0&6$UDELFUHFRJQLWLRQQHXUDOQHWZRUNVWFKHELFKHIPRPHQWVKXPRPHQWVDQG=HUQLNHPRPHQWV 5HFHLYHG'HFHPEHUDFFHSWHG0DUFK

,QWURGXFWLRQ 7KH UHVHDUFK GRPDLQ RI 0XOWLSOH &ODVVLILHU 6\VWHPV 0&6 H[DPLQHVKRZVHYHUDOFODVVLILHUVFDQEHDSSOLHG WRJHWKHU WR REWDLQ EHWWHU FODVVLILFDWLRQ V\VWHPV 0&6 PHWKRGV PD\ EH XVHG WR LQFUHDVH WKH VSHHG RI WKH V\VWHPRUWRUHGXFHWKHWLPHWDNHQIRUWKHGHVLJQRIWKH FODVVLILFDWLRQV\VWHP7KHUHDUHWKUHHEDVLFVWUXFWXUHV RI FODVVLILHU FRPELQDWLRQ VHULDO SDUDOOHO DQG FRQGLWLRQDO ,Q D VHULDO FRPELQDWLRQ WKH RXWSXW RI D FODVVLILHU LV WKH LQSXW RI WKH QH[W FODVVLILHU ,Q FRQGLWLRQDO FRPELQDWLRQ VRPH FODVVLILHUV DUH RQO\ DSSOLHGLIWKHRXWSXWRIRWKHUFODVVLILHUVPHHWVDFHUWDLQ FRQGLWLRQ ,QDSDUDOOHOFRPELQDWLRQWKHRXWSXWRIDOOFODVVLILHUV LV FRPELQHG LQ D ODVW VWHS WR D VLQJOH RXWSXW 7KLV FRPELQDWLRQ LV YHU\ SRSXODU EHFDXVH HDFK FODVVLILHU WKDW VROYHV WKH FODVVLILFDWLRQ SUREOHP PD\ EH XVHG 7KHUHDUHPDQ\ZD\VWRFRPELQHLQSDUDOOHOWKHUHVXOWV RI D VHW RI FODVVLILHUV GHSHQGLQJ RQ WKH W\SH RI WKH FODVVLILHUV¶RXWSXW,IWKHRXWSXWLVRQO\WKHEHVWUDQNHG FODVV WKHQ PDMRULW\ YRWLQJ FDQ EH DSSOLHG >@ 0RUH VRSKLVWLFDWHG YRWLQJ VFKHPHV DOVR ORRN DW WKH SUREDELOLW\ RI WKH FODVVLILFDWLRQ HUURU IRU D VSHFLILF FODVV %D\HVLDQ &RPELQDWLRQ 5XOH >@ DQG WKH GHSHQGHQFLHV EHWZHHQ WKH FODVVLILHUV %HKDYLRU .QRZOHGJH6SDFH>@ 6RPHFODVVLILHUVKDYHDUDQNHG OLVW RI FODVVHV DV RXWSXW )RU WKHP RIWHQ %RUGD FRXQW >@RUUHODWHGPHWKRGVDUHXVHG6RPHFODVVLILHUVDOVR JHQHUDWH D VFRUH YDOXH IRU HDFK FODVV ,Q WKLV FDVH WKH VXP SURGXFW PD[LPXP PLQLPXP RU WKH PHGLDQ RI WKHVFRUHVRIDOOFODVVLILHUVFDQEHFDOFXODWHG>@DQG

WKH FODVV ZLWK WKH KLJKHVW YDOXH LV UHJDUGHG DV WKH FRPELQHGUHVXOW$QRWKHUDSSURDFKLVWRXVHWKHVFRUH YDOXHVRXWSXWE\WKHLQGLYLGXDOFODVVLILHUVDVLQSXWIRUD WUDLQDEOH FODVVLILHU HJ D QHXUDOQHWZRUN >@ ZKLFK DFWVDVWKHFRPELQHU 1HXUDO QHWZRUN FODVVLILHUV H[KLELW SRZHUIXO GLVFULPLQDWLYH SURSHUWLHV DQG WKH\ KDYH EHHQ XVHG LQ 2SWLFDO&KDUDFWHU5HFRJQLWLRQLPSOHPHQWDWLRQ0/3LV XVXDOO\DFRPPRQFKRLFHEHFDXVHWKH\DUHYHU\HDV\WR WUDLQ DQG YHU\ IDVW WR XVH LQ FODVVLILFDWLRQ GHFLVLRQ SURFHVV5DGLDO%DVLV)XQFWLRQ5%) QHWZRUNVRQWKH RWKHU KDQG RIIHU EHWWHU IHDWXUHV IRU UHFRJQLWLRQ DSSOLFDWLRQVLQDGGLWLRQWRKLJKO\HIILFLHQWWUDLQLQJQR GHVLJQ GHWDLOV DUH UHTXLUHG VLQFH WKH QHWZRUN DXWRPDWLFDOO\ DGMXVWV LWV VLQJOH KLGGHQ OD\HU 7KH )X]]\$57DUFKLWHFWXUHH[KLELWVFRQVLGHUDEOHVWDELOLW\ DQG FDQ HDVLO\ LQWHJUDWHV ZLWK RWKHU KLHUDUFKLFDO WKHRULHVRIUHFRJQLWLRQ ,Q WKLV FDVH VWXG\ RXU UHVHDUFK DLPV DW GHYHORSLQJ DQ DXWRPDWLF UHFRJQLWLRQ V\VWHP IRU RIIOLQH $UDELF KDQGZULWWHQ ZRUGV XVLQJ D SDUDOOHO FRPELQDWLRQ VFKHPH EHWZHHQ D )X]]\ $57 0/3 DQG 5%) QHWZRUNV ZH IRFXV RQ WKUHH FRPELQLQJ PHWKRGV PDMRULW\YRWHPD[UXOHDQGVXPUXOH:HDOVRDSSOLHG WKUHHW\SHVRIPRPHQWVDVIHDWXUHV 7KLVSDSHULVRUJDQL]HGDVIROORZVVHFWLRQEULHIO\ UHYLHZV WKH $UDELF VFULSW FKDUDFWHULVWLFV ,Q VHFWLRQ UHODWHG ZRUNV FRQFHUQLQJ 0&6 LPSOHPHQWHG IRU $UDELF VFULSW DUH JLYHQ 8VHG QHXUDO QHWZRUNV DUH GHWDLOHG LQ VHFWLRQ ,Q VHFWLRQ ZH LQWURGXFH WKH WKUHH W\SHV RI PRPHQWV FKRVHQ DV IXWXUHV IRU RXU DSSOLFDWLRQ 6HFWLRQ UHSRUWV WKH H[SHULPHQWDO UHVXOWV

&RPELQLQJ1HXUDO1HWZRUNVIRU$UDELF+DQGZULWLQJ5HFRJQLWLRQ

FRQGXFWHG RQ WKH SXEOLFO\ DYDLODEOH ,)1(1,7 GDWDEDVH RI KDQGZULWWHQ 7XQLVLDQ WRZQ QDPHV LQFOXGLQJ V\VWHP SDUDPHWHUV DQG DUFKLWHFWXUH FRPELQLQJ PHWKRGV DQG FRPSDULVRQ ZLWK RWKHU V\VWHPV)LQDOO\ZHFRQFOXGHWKHZRUNDQGGLVFXVVWKH IXWXUHGLUHFWLRQVLQWKHODVWVHFWLRQ

x 6SDFLQJ PD\ VHSDUDWH QRW RQO\ ZRUGV EXW DOVR FHUWDLQFKDUDFWHUVZLWKLQDZRUGIRUPLQJVXEZRUGV x 6RPHFKDUDFWHUVFRQWDLQFORVHGORRSV

$UDELF6FULSW

&RPSDUHGWR/DWLQVFULSWZKHUHDORWRIUHVHDUFKZRUN LVGRQHWKHQXPEHURIZRUNIRU0&6RI$UDELFVFULSW LVTXLWHOLPLWHG2QHRIWKHILUVWZRUNVLQWKLVILHOGZDV JLYHQ E\ )DUDK HW DO >@ ZKR LQWURGXFHG D V\VWHP EDVHG RQ WKH FRPELQDWLRQ RI WKUHH 0XOWL /D\HU 3HUFHSWURQV IRU WKH UHFRJQLWLRQ RI $UDELF OLWHUDO DPRXQWZLWKDUHFRJQLWLRQUDWHRIRQDVPDOOWHVW GDWDEDVHFRQWDLQLQJZRUGV(O+DMMHWDO>@KDYH XVHG1HXUDO1HWZRUNVWRFRPELQHWKUHHKRPRJHQHRXV +00EDVHG FODVVLILHUV ZKLFK KDYH GLIIHUHQW IHDWXUHV DVLQSXWWKH\XVHGWKH,)1(1,7GDWDEDVHDFKLHYLQJD UHFRJQLWLRQ UDWH RI ,Q >@ D VWUDWHJ\ IRU $UDELF KDQGZULWWHQ ZRUG UHFRJQLWLRQ KDV EHHQ SURSRVHG E\ 0LOHG WKH LGHD LV EDVHG RQ D VHTXHQWLDO KLHUDUFKLFDO FRRSHUDWLRQ RI WKUHH FODVVLILHUV DOO RI D 0DUNRYLDQ W\SH 7KH ILUVW FODVVLILHU LV EDVHG RQ D JOREDO GHVFULSWLRQ RI WKH ZRUG XVLQJ VHTXHQWLDO YLVXDO LQGLFHV 7KH VHFRQG FODVVLILHU LV DVVRFLDWHG ZLWK DQ DQDO\WLF DSSURDFK WKDW PRGHOV WKH FKDUDFWHUV GHSULYHG RIWKHLUGLDFULWLFGRWV7KHWKLUGFODVVLILHULVDVVRFLDWHG WR WKH VXEZRUG 'LIIHUHQW W\SHV RI FRPELQDWLRQV PHWKRGVZHUHWHVWHGPHDVXUHUDQNKLHUDUFK\FODVV 7KH UDWHV RI UHFRJQLWLRQ RI WKH V\VWHP H[FHHG 7KLVUHSUHVHQWVDQLQFUHDVHRIDERXWZLWKUHVSHFWWR WKH EHVW SHUIRUPLQJ FODVVLILHU WDNHQ LQGLYLGXDOO\ $OPD¶DGHHG >@ FRPELQHG D UXOH EDVHG UHFRJQL]HU ZLWK D VHW RI +00V WR UHFRJQL]H ZRUGV LQ D EDQN FKHFNOH[LFRQRIZRUGV7KHUXOHEDVHGHQJLQHXVHG DVFHQGHUV GHVFHQGHUV DQG RWKHU VWUXFWXUDO IHDWXUHV WR VHSDUDWH WKH GDWD LQWR JURXSV RI ZRUGV DQG DQ +00 FODVVLILHU IRU HDFK JURXS XVHG IUDPHEDVHG IHDWXUHV WR GHWHUPLQH WKH ZRUG 7KH V\VWHP ZDV WHVWHG RQ DERXW ZRUGV FROOHFWLYHO\ ZULWWHQ E\ ZULWHUV H[FOXGLQJ DERXW RI WKH ZRUGV GXH WR HUURUV LQ EDVHOLQH GHWHFWLRQ DQG SUHSURFHVVLQJ $ QHDU UHFRJQLWLRQUDWHZDVDFKLHYHG 6RXLFL0HVODWLDQG 6HOODPL >@ SUHVHQWHGD K\EULG DSSURDFKWRWKHUHFRJQLWLRQRIOLWHUDODPRXQWVRQEDQN FKHFNV 7KUHH FODVVLILHUV UDQ LQ SDUDOOHO QHXUDO QHWZRUNV .QHDUHVWQHLJKERXU DQG )X]]\ .QHDUHVW QHLJKERXU 7KH RXWSXWV ZHUH FRPELQHG E\ ZRUGOHYHO VFRUHVXPPDWLRQZRUGE\ZULWHUVZHUHXVHG IRU WUDLQLQJ DQG ZRUGV IRU WHVWLQJ 7KH UHFRJQLWLRQ UDWH ZDV ,Q >@ %XUURZ DSSOLHG RQH .1HDUHVW 1HLJKERXUV FODVVLILFDWLRQ DSSURDFK WR HDFK VXEZRUGDPDMRULW\YRWHLVWDNHQRQLWVRYHUDOOFODVV DQG UHSHDWHG IRU HDFK VXEZRUG VDPSOH )LUVW UHVXOWV UHVXOWLQDFFXUDF\%\UHILQLQJWKHVFRULQJV\VWHP DQG DGGLQJ VRPH IHDWXUHV LQFOXGLQJ WKH QXPEHU RI GRWV WKH DXWKRU VFRUHV DW IRU VXEZRUG RQ FRUUHFWO\UHSUHVHQWHGFODVVHV

$UDELF RQH RI WKH VL[ 8QLWHG 1DWLRQV RIILFLDO ODQJXDJHV LV WKH PRWKHU WRQJXH RI PRUH WKDQ PLOOLRQ SHRSOH 7KH $UDELF VFULSW HYROYHG IURP WKH 1DEDWDHDQ $UDPDLF VFULSW ,W KDV EHHQ XVHG VLQFH WKH WK FHQWXU\ $' WKH PRVW IHDWXUHV RI $UDELF ODQJXDJH DUH x 7KH $UDELF VFULSW LV FXUVLYH DQG LW LV ZULWWHQ IURP ULJKWWROHIW>@ x $V LOOXVWUDWHG LQ )LJXUH WKH $UDELF DOSKDEHW FRQWDLQV OHWWHUV DQG PRVW OHWWHUV FKDQJH IRUP GHSHQGLQJRQZKHWKHUWKH\DSSHDUDWWKHEHJLQQLQJ PLGGOHRUHQGRIDZRUGRURQWKHLURZQ

)LJXUH$UDELFDOSKDEHW

x 7KHORQJYRZHOVDLDQGXDUHUHSUHVHQWHGE\ WKHOHWWHUV DOLI\Ɨ DQGZƗZUHVSHFWLYHO\ x 7KH $UDELF FKDUDFWHUV RI D ZRUG DUH FRQQHFWHG DORQJ D EDVHOLQH $ EDVHOLQH LV WKH OLQH ZLWK WKH KLJKHVWGHQVLW\RIEODFNSL[HOV x ,QDGGLWLRQWRFRQQHFWLYLW\YRZHOGLDFULWLFVLJQVDUH DQ HVVHQWLDO SDUW RI ZULWWHQ $UDELF 9RZHOV DUH UHSUHVHQWHGLQWKHIRUPRIRYHUVFRUHVRUXQGHUVFRUHV x 0DQ\ $UDELF FKDUDFWHUV KDYH GRWV ZKLFK DUH SRVLWLRQHGDERYHRUEHORZWKHOHWWHUERG\'RWVFDQ EH VLQJOH GRXEOH RU WULSOH 'LIIHUHQW $UDELF OHWWHUV FDQKDYHWKHVDPHERG\DQGGLIIHULQWKHQXPEHURI GRWVLGHQWLI\LQJWKHP x &KDUDFWHUV LQ DQ $UDELF VFULSW XVXDOO\ RYHUODS ZLWK WKHLU QHLJKERXULQJ OHWWHUV GHSHQGLQJ RQ WKHLU SRVLWLRQ LQ WKH ZRUG 7KH GHJUHH RI RYHUODSSLQJ YDULHV GHSHQGLQJ RQ WKH VL]H DQG VW\OH RI WKH FKDUDFWHU x &HUWDLQ FKDUDFWHU FRPELQDWLRQV IRUP QHZ OLJDWXUH VKDSHVZKLFKDUHRIWHQIRQWGHSHQGHQW

5HODWHG:RUNV


1HXUDO1HWZRUN 1HXUDOQHWZRUNVKDYHEHHQDPXFKSXEOLFL]HGWRSLFRI UHVHDUFK LQ UHFHQW \HDUV DQG DUH QRZ EHJLQQLQJ WR EH XVHG LQ D ZLGH UDQJH RI VXEMHFW DUHDV 2QH RI WKH VWUDQGV RI LQWHUHVW LQ QHXUDO QHWZRUNV LV WR H[SORUH SRVVLEOH PRGHOV RI ELRORJLFDO FRPSXWDWLRQ 1HXUDO QHWZRUNVWUXFWXUHLVDFROOHFWLRQRISDUDOOHOSURFHVVRUV FRQQHFWHG WRJHWKHU LQ WKH IRUP RI D GLUHFWHG JUDSK RUJDQL]HGVXFKWKDWWKHQHWZRUNVWUXFWXUHOHQGVLWVHOIWR WKHSUREOHPEHLQJFRQVLGHUHGWKH\DUHVSHFLILHGE\WKH QHW WRSRORJ\ QRGH FKDUDFWHULVWLFV DQG WUDLQLQJ RU OHDUQLQJ UXOHV ,Q RXU V\VWHP ZH KDYH LPSOHPHQWHG WKUHHNLQGRIQHXUDOQHWZRUN

$GDSWLYH5HVRQDQFH7KHRU\ $GDSWLYH 5HVRQDQFH 7KHRU\ $57 LV D IDPLO\ RI DOJRULWKPV IRU LQFUHPHQWDO XQVXSHUYLVHG OHDUQLQJ GHYHORSHG E\ &DUSHQWHU DQG *URVVEHUJ >@ 7KH $57 QHXUDO QHWZRUN LV D W\SLFDO UHSUHVHQWDWLYH RI FRPSHWLWLYHQHWZRUNV7KH)X]]\$57QHXUDOQHWZRUN KDV WZR DGYDQWDJHV RQH LV WKH DELOLW\ WR KDQGOH ERWK ELQDU\ DQG DQDORJ\ YHFWRUV DQG WKH RWKHU LV IDVWHU LPSOHPHQWDWLRQ )X]]\ $57 LV D JHQHUDOL]HG $57 PHWKRG ZKLFK LVUHVWULFWHGWRFRQWLQXRXVELQDU\GDWDLQWKHLQWHUYDORI > @ ,W LV VLPLODU WR PDQ\ LWHUDWLYH FOXVWHULQJ DOJRULWKPVZKHUHHDFKSDWWHUQLVSURFHVVHGE\ILQGLQJ WKHQHDUHVWFOXVWHUDQGWKHQXSGDWLQJWKDWFOXVWHUWREH FORVHU WR WKH SDWWHUQ +RZHYHU LQ WKH IUDPHZRUN RI )X]]\ $57 LV D OLWWOH FKDQJHG E\ LQWURGXFLQJ WKH FRQFHSWRIUHVRQDQFHVRWKDWHDFKFDVHLVSURFHVVHGE\ ILUVWILQGLQJWKHQHDUHVWFOXVWHUVHHGWKDWUHVRQDWHVZLWK WKH FDVH DQG WKHQ XSGDWLQJ WKDW FOXVWHU VHHG 5HVRQDQFH LV MXVW D PDWWHU RI EHLQJ ZLWKLQ D FHUWDLQ WKUHVKROG RI D VHFRQG VLPLODULW\ PHDVXUH )X]]\ $57 WDNHV WKUHH LQSXW SDUDPHWHUV FKRLFH SDUDPHWHU ȕ! YLJLODQFH SDUDPHWHU S DQG OHDUQLQJ UDWH Ȝ 7KH GHWDLO RI WUDLQLQJ )X]]\ $57 DOJRULWKP LV JLYHQLQ>@ &RPSHWLWLYH OD\HU) M «0

:HLJKWV :

&RPSDUDLVRQ OD\HU) «1

0 RR

:HLJKWV 7

; [[«[1[[«[1

)LJXUH)X]]\$57QHWZRUN

ȡ

1

5DGLDO%DVLV)XQFWLRQ

DURXQG WKH PHDQ YHFWRU ZKLFK LV WKH FHQWURLG RI WKH FOXVWHUV IRUPHG LQ WKH XQVXSHUYLVHG OHDUQLQJ VWDJH KHQFH WKH QDPH UDGLDO EDVLV IXQFWLRQ 7KH 5%) QHWZRUNV DUH WZROD\HU QHWZRUNV LQ ZKLFK WKH ILUVW OD\HU QRGHV UHSUHVHQW UDGLDO IXQFWLRQV XVXDOO\ *DXVVLDQ 7KH VHFRQG OD\HU ZHLJKWV DUH XVHG WR FRPELQH OLQHDUO\ WKH LQGLYLGXDO UDGLDO IXQFWLRQV DQG WKH ZHLJKWV DUH DGDSWHG YLD D OLQHDU OHDVW VTXDUHV DOJRULWKP GXULQJ WKH WUDLQLQJ E\ VXSHUYLVHG OHDUQLQJ 7KH DFWLYDWLRQ IXQFWLRQ RI RXWSXW QRGHV FDQ EH HLWKHU OLQHDU RU VLJPRLGDO WR IDFLOLWDWH PLQLPXP HUURU WUDLQLQJ E\ JUDGLHQW GHVFHQW DQG PDNH WKH RXWSXW YDOXHV DSSUR[LPDWH D SRVWHULRUL SUREDELOLWLHV ZH XVH VLJPRLG IXQFWLRQV LQ WKH RXWSXW OD\HU )RU DQ 5%) QHWZRUN ZLWK G LQSXW VLJQDOV P KLGGHQ XQLWV DQG 0 RXWSXW XQLWV DVVXPH VSKHULFDO *DXVVLDQ IXQFWLRQV IRU WKHKLGGHQQRGHV ĳ M [

§ [ȝ M H[S ¨ ¨ ı M ©

· ¸ M ¸ ¹

P

ZKHUHMLVWKHFHQWHU*DXVVLDQDQG V M LVWKHYDULDQFH 7KHOLQHDUFRPELQDWLRQRI*DXVVLDQIXQFWLRQV

P

\ N [ X N [

¦ Z I [ Z NM

M

N

M

¦ Z I [ NM

M

P

N 0

M

8QGHU VXSHUYLVHG WUDLQLQJ RI DOO SDUDPHWHUV WKH 5%) QHWZRUN FDQ DFKLHYH D KLJKHU FODVVLILFDWLRQ SHUIRUPDQFHZLWKPXFKIHZHUKLGGHQQRGHV7KLVFDQ FRPSHWH RU HYHQ H[FHHG WKH 0XOWL/D\HU 3HUFHSWURQ 7KHWUDLQLQJDOJRULWKPLVGHVFULEHGLQ>@

0XOWL/D\HU3HUFHSWURQ 0/3 QHWZRUNV DUH ZLGHO\ XVHG LQ KDQGZULWWHQ UHFRJQLWLRQV\VWHPVEHFDXVHWKH\DUHYHU\HDV\WRWUDLQ DQG YHU\ IDVW WR XVH LQ FODVVLILFDWLRQ GHFLVLRQ SURFHVVHV 7KLV SRSXODULW\ LV UHODWHG WR WKH XVH RI WKH JUDGLHQWEDFNSURSDJDWLRQDOJRULWKP>@LQWKHWUDLQLQJ SURFHVV0/3VJHQHUDOO\DFKLHYHJRRGSHUIRUPDQFHLQ WHUPV RI FRUUHFW UHFRJQLWLRQ UDWH LQ KDQGZULWWHQ FODVVLILFDWLRQ :KHQ DGRSWLQJ 0/3V WKH ZRUG LPDJH LVSUHSURFHVVHGVRDVWR\LHOGDIHDWXUHYHFWRUZKLFK LV XVHG IRU IHHGLQJ WKH QHXUDO QHWZRUN 7KH FODVV PHPEHUVKLSLVFRPPRQO\JLYHQE\H[FOXVLYHFRGLQJRI WKH RXWSXW RQHKRW FRGLQJ 'XULQJ WKH UHFRJQLWLRQ SKDVHWKHQHWZRUNLVIHGZLWKWKHLQSXWSDWWHUQZKLFK LVSURSDJDWHGWKURXJKIRUZDUGVWHSVWRWKHRXWSXWV7KH H[SHFWHGFODVVLVVLPSO\JLYHQE\WKHRXWSXWXQLWZLWK WKH KLJKHVW YDOXH 7KH FODVVLILHU FDQ UHMHFW SDWWHUQV ZKRVHPHPEHUVKLSFDQQRWEHFOHDUO\HVWDEOLVKHG $ W\SLFDO FODVVLILFDWLRQ FULWHULRQ ZKLFK LV XVHG FRQVLVWVRIUHMHFWLQJDSDWWHUQLI

5%)LVDFRPELQDWLRQRIXQVXSHUYLVHGDQGVXSHUYLVHG OHDUQLQJ 7KH EDVLV IXQFWLRQ LV UDGLDO DQG V\PPHWULF

\

PD[ ^\ L ` 50

L Q


ZKHUH Q LV WKH QXPEHU RI FODVVHV \ L LV WKH LWK RXWSXW RI WKH QHWZRUN DQG 50 LV D SURSHU WKUHVKROG 8QIRUWXQDWHO\ WKHUH DUH OLPLWV ZKHQ XVLQJ 0/3V LQ FODVVLILFDWLRQ WDVNV )LUVW WKHUH LV QR WKHRUHWLF UHODWLRQVKLS EHWZHHQ WKH 0/3 VWUXFWXUH H[ KLGGHQ OD\HUV QXPEHU DQG QRGHV QXPEHU SHU OD\HU DQG WKH FODVVLILFDWLRQWDVN7KHVHFRQGOLPLWDWLRQLVGXHWRWKH IDFWWKDW0/3GHULYHVVHSDUDWLQJK\SHUSODQHVXUIDFHV LQ IHDWXUH UHSUHVHQWDWLRQ VSDFH ZKLFK DUH QRW RSWLPDO LQ WHUPV RI WKH PDUJLQ DUHD EHWZHHQ WKH H[DPSOHV RI WZRGLIIHUHQW FODVVHV 7R WUDLQ WKH 0/3 QHWZRUN ZH KDYH XVHG %DFN 3URSDJDWLRQ DOJRULWKP %3 >@ 7KLV DOJRULWKP SHUIRUPV D JUDGLHQW GHVFHQW LQ WKH FRQQHFWLRQ ZHLJKW VSDFH RQ DQ HUURU VXUIDFH GHILQHG E\

¦ ( S S S

(

LQYDULDQWXQGHULPDJHWUDQVODWLRQVFDOLQJDQGURWDWLRQ 7KH FHQWUDO PRPHQWV ZKLFK DUH LQYDULDQW XQGHU DQ\ WUDQVODWLRQDUHGHILQHGDV

f f

S

T

I [ \ G[G\

:KHUH

0

[ 0

0 0

\

DQG

f f

³ ³[

0 ST

S

\ T I [ \ G[G\

f f

KRZHYHU IRU LPDJHV WKH FRQWLQXRXV LPDJH LQWHQVLW\ IXQFWLRQI[\ LVUHSODFHGE\DPDWUL[ZKHUH[DQG\ DUH WKH GLVFUHWH ORFDWLRQV RI WKH LPDJH SL[HOV 7KH LQWHJUDOVLQHTXDWLRQVDQGDUHDSSUR[LPDWHGE\WKH VXPPDWLRQV 0

:KHUH

ff

P

Q

¦¦ [ [

ST

S

\ \ T I [ \ G[G\

[ \

( S

¦ W SN \ SN .

KHUH3LVWKHWRWDOQXPEHURISDWWHUQVLQWKHWUDLQLQJVHW DQG ^W SN ` ^\ SN `DUH UHVSHFWLYHO\ WKH WDUJHW DQG RXWSXW YHFWRUV FRUUHVSRQGLQJ WR WKH SWK LQSXW SDWWHUQ 7KH TXDQWLW\(LVFDOOHGWKHV\VWHPHUURU,Q%3DOJRULWKP ZHLJKWXSGDWLQJUXOHVDUHJLYHQE\

Z MN W

Z MN W K

w( S W wZ MN

D'Z MN W W

ZLM W

w( S W

D'ZLM W ZLM W K wZ W LM

ZKHUH Z MN W LVWKHZHLJKWFRQQHFWLQJDKLGGHQQRGHM ZLWK DQ RXWSXW QRGH N ZKLOH ZLM W LV WKH ZHLJKW FRQQHFWLQJDQLQSXWQRGHLZLWKDKLGGHQQRGHMDWWLPH W 'Z MN W LV WKH PRGLILFDWLRQ DPRXQW WR Z MN DW WLPH W K ! DQG D D DUH UHVSHFWLYHO\ FDOOHG WKH OHDUQLQJUDWHDQGPRPHQWIDFWRU

0

0RPHQWV DQG IXQFWLRQV RI PRPHQWV KDYH EHHQ HPSOR\HGDVSDWWHUQIHDWXUHVLQQXPHURXVDSSOLFDWLRQV WR UHFRJQL]H WZRGLPHQVLRQDO LPDJH SDWWHUQV 7KHVH SDWWHUQ IHDWXUHV H[WUDFW JOREDO SURSHUWLHV RI WKH LPDJH VXFK DV WKH VKDSH DUHD WKH FHQWHU RI WKH PDVV WKH PRPHQW RI LQHUWLD DQG VR RQ 0RPHQWV XVHG LQ WKLV DSSOLFDWLRQDUH

+XPRPHQWV ,QRXULPSOHPHQWDWLRQPRPHQWLQYDULDQWVXVHGE\+X >@ KDYH EHHQ XWLOL]HG WR EXLOG WKH IHDWXUH VSDFH IRU 0/3 FODVVLILHU 8VLQJ QRQOLQHDU FRPELQDWLRQV RI JHRPHWULF PRPHQWV +X GHULYHG D VHW RI LQYDULDQW PRPHQWV ZKLFK KDV WKH GHVLUDEOH SURSHUW\ RI EHLQJ

P

ST

Q

¦¦ [

S

\ T I [ \ G[G\

[ \

ZKHUHPDQGQDUHGLPHQVLRQVRIWKHLPDJH7KHVHWRI PRPHQWLQYDULDQWVWKDWKDVEHHQXVHGE\+XDUHJLYHQ E\

I

0 0

I

0 0 0

I

0 0 0 0

I

0 0 0 0

M 0 0 0 0 >0 0 0 0 @ 0 0

0 0 >0 0 0 0 @

M

0 0 > 0 0 0 0 @

0 0 0 0 0

M

,QYDULDQW0RPHQWV

³ ³ [ [ \ \

0 ST

0 0 0 0 >0 0

0 0 @ 0 0 0 0

>0 0 0 0 @

7KHVH IXQFWLRQV FDQ EH QRUPDOL]HG WR PDNH WKHP LQYDULDQWXQGHUDVFDOHFKDQJHE\XVLQJWKHQRUPDOL]HG FHQWUDO PRPHQWV LQVWHDG RI WKH FHQWUDO PRPHQWV 7KH QRUPDOL]HGFHQWUDOPRPHQWVDUHGHILQHGE\

0 ST

0 ST 0

D

ZKHUH

D

S T

7KHVHZKHQVXEVWLWXWHGLQWRWKHDERYHHTXDWLRQVZLOO JLYHVHYHQPRPHQWVZKLFKDUHLQYDULDQWWRWUDQVODWLRQ VFDOHFKDQJHDQGURWDWLRQ 7KH ¡V KDYH ODUJH G\QDPLF YDOXHV 7KXV LW ZDV IRXQG WKDW LW ZDV PRUH SUDFWLFDO WR GHDO ZLWK WKH ORJDULWKPVRIWKHDEVROXWHYDOXHRIWKH¡V>@WKXVWKH


VHYHQPRPHQWLQYDULDQWVXVHGLQWKHSURSRVHGV\VWHP DUHUHSODFHGE\WKHLUORJDULWKPLFYDOXHV7DEOHVKRZV WKHURXQGHGYDOXHVRI¡REWDLQHGIRUVRPHRIWKHZRUGV LQWKHWUDLQLQJVHW 7DEOH0RPHQWLQYDULDQWYDOXHVIRUWKUHHZRUGV

7FKHELFKHI0RPHQWV )RU )X]]\ $57 ZH KDYH RSWHG IRU 7FKHELFKHI JHRPHWULF PRPHQWV ,Q WKHVH PRPHQWV WKH EDVLV IXQFWLRQ LV WKH GLVFUHWH RUWKRJRQDO 7FKHELFKHI SRO\QRPLDO )RU D JLYHQ SRVLWLYH LQWHJHU 1 QRUPDOO\ WKHLPDJHVL]H WKH7FKHELFKHISRO\QRPLDOLVJLYHQE\ WKHIROORZLQJUHFXUUHQFHUHODWLRQ

Q W [ WQ [ Q WQ [

Q WQ [ 1

ZLWKWKHLQLWLDOFRQGLWLRQV

W [

W [

[ 1 1

=HUQLNH PRPHQWV DUH FKRVHQ IRU 5%) QHWZRUN =HUQLNH >@ GHILQHG DFRPSOHWH RUWKRJRQDO VHW ^9QP[ \ `RIFRPSOH[SRO\QRPLDOVRYHUWKHSRODUFRRUGLQDWH VSDFHLQVLGHDXQLWFLUFOH[\ DVIROORZV

ZKHUH M QPLVDSRVLWLYHRUQHJDWLYHLQWHJHU _P_QQí_P_LVHYHQȡLVWKHVKRUWHVWGLVWDQFHIURPWKH RULJLQ WR [ \ SL[HO ș LV WKH DQJOH EHWZHHQ YHFWRU ȡ DQG[D[LVLQFRXQWHUFORFNZLVHGLUHFWLRQDQG5QPȡ LV WKHRUWKRJRQDOUDGLDOSRO\QRPLDOJLYHQE\

V

V

Q V U QV §Q P · Q P V ¸¸ V¨¨ V © ¹

1RWH WKDW 5QPȡ 5QPȡ 7KHVH SRO\QRPLDOV DUH RUWKRJRQDODQGVDWLVI\WKHIROORZLQJFRQGLWLRQ

³ ³ >9

[ \ @ 9 ST [ \ G[ G\

QP

[ \ d

S Q

G QS G P T

:KHUH

LI D E ® ¯ RWKHUZLVH

G DE

=HUQLNH PRPHQWV DUH WKH SURMHFWLRQ RI WKH LPDJH LQWHQVLW\ IXQFWLRQ I [ \ RQWR WKH FRPSOH[ FRQMXJDWH RI WKH SUHYLRXVO\ GHILQHG =HUQLNH SRO\QRPLDO 9QPȡ ș ZKLFKLVGHILQHGRQO\RYHUWKHXQLWFLUFOH

$QP

Q

S

³ ³ I [ \ 9

QP

1 1 W P [ W Q \ I [ \ U P 1 U Q 1 [ \

¦¦

:KHUH QP «1 7KH 7FKHELFKHI SRO\QRPLDO VDWLVILHVWKHSURSHUW\RIRUWKRJRQDOOLW\ZLWK

¦

7QP

5QP U H MPT

9QP [ \ 9 QP U T

Q P

ZKHUHQ «17KH7FKHELFKHIPRPHQWRIRUGHU ST RIDQLPDJHLQWHQVLW\IXQFWLRQLVGHILQHGDV

=HUQLNH0RPHQWV

5QP U

Q

U T G[G\

[ \ d

1

U Q 1

Q 1 1 1 Q

([SHULPHQWV5HVXOWV :H WHVWHG WKH WKUHH FODVVLILHUV RQ WKH ,)1(1,7 GDWDEDVH>@,)1(1,7ZDVSURGXFHGE\WKH,QVWLWXWH IRU &RPPXQLFDWLRQV 7HFKQRORJ\ DW WKH 7HFKQLFDO 8QLYHUVLW\ RI %UDXQVFKZHLJ ,)1 DQG WKH ³(FROH 1DWLRQDOHG¶,QJpQLHXUVGH7XQLV´7KHWRWDOQXPEHURI ELQDU\ LPDJHV RI KDQGZULWWHQ 7XQLVLDQ WRZQYLOODJH QDPHV LV 7KRVH QDPHV ZHUH ZULWWHQ E\ ZULWHUVDQGWKH\ZHUHODEHOOHGDFFRUGLQJWRQDPH FODVVHV :H KDYH XVHG DV SURJUDPPLQJ ODQJXDJH 'HOSKL $UFKLWHFW DQG LPSOHPHQWHG RXU DSSOLFDWLRQ RQ 0LFURVRIW :LQGRZV ;3 SURIHVVLRQDO SODWIRUP $OOH[SHULPHQWVDUHSHUIRUPHGRQDQ,QWHO3HQWLXP ,9 *+] SHUVRQDO FRPSXWHU ZLWK 0E RI 5$0 7UDLQLQJ RI 0/3 LV REWDLQHG ZLWK F\FOH FRQVXPHG K FRQFHUQLQJ )X]]\ $57 WUDLQLQJ LV REWDLQHGZLWKLWHUDWLRQVWDNLQJPQILQDOO\5%) WDFNHGKZLWKLWHUDWLRQV$QDYHUDJHSURFHVVLQJ WLPH RI PV SHU QDPH LPDJH RQ WKH WHVW VHW LV REWDLQHGE\WKHFRPELQLQJUXOH

6\VWHP$UFKLWHFWXUH

)RUDGLJLWDOLPDJH=HUQLNHPRPHQWVDUHJLYHQE\

$QP

Q

S

¦ ¦ I [ \ 9

QP

[

\

U T [ \ d

7KH GLDJUDP RI WKH RIIOLQH $UDELF ZRUG UHFRJQLWLRQ V\VWHPLVVKRZQLQ)LJXUH7KHUHFRJQLWLRQSURFHVV W\SLFDOO\ FRQVLVWV RI WKUHH VWDJHV SUHSURFHVVLQJ IHDWXUHH[WUDFWLRQDQGFODVVLILFDWLRQ


QRUPDOL]DWLRQ DQG VNHZ FRUUHFWLRQ VKRXOG EH XVHG SULRUWR7FKHELFKHIPRPHQWH[WUDFWLRQ

3UHSURFHVVLQJ 1RUPDOLVDWLRQVNHZ GHWHFWLRQDQGFRUUHFWLRQ WKLQQLQJ

+X PRPHQWV FDOFXO

0/3

7FKHELFKHI PRPHQWV FDOFXO

)X]]\$57

=HUQLNH 0RPHQWV FDOFXO

5%)

)LJXUH7KLQQLQJH[DPSOH

6\VWHP3DUDPHWHUV

&RPELQLQJ UXOH

:RUGFODVV

)LJXUH6WUXFWXUHRIWKHSURSRVHG2&5V\VWHP

,Q SUHSURFHVVLQJ SKDVH ZH KDYH DSSOLHG D QRUPDOLVDWLRQDOJRULWKP>@JLYLQJDXQLIRUPHGVL]HRI [SL[HOV)LJXUHLOOXVWUDWHVDQH[DPSOH

&RQFHUQLQJ )X]]\ $57 1HWZRUN ZH KDYH XVHG LQSXW QHXURQHV FRUUHVSRQGLQJ WR WKH ILUVW 7FKHELFKHIPRPHQWV$OVRZHKDYHVWXG\WKHHIIHFWRI YDU\LQJYLJLODQFHSDUDPHWHUȡDFFRUGLQJWRWKHQXPEHU RI FODVV )LJXUH VKRZVWKH QXPEHU RIFODVVGHWHFWHG E\GLYHUVHYLJLODQFHSDUDPHWHUV U >@ :HREVHUYHG WKDW LI WKH YLJLODQFH XVHG LV VPDOOHU WKH QXPEHU RI FODVV ,I ȡ WKH QXPEHU RI FODVVHV DFKLHYHG LV )XUWKHUPRUH LI ȡ WKH QXPEHU RI FODVVHV IRXQG VXUSDVV RQH KXQGUHG :H XVH ȡ DV RXU EHQFKPDUN IRU WKH IROORZLQJ H[SHULPHQWV GXH WR LWV SHUIRUPDQFHIRXQG ϮϱϬ

1XPEHURIFODVV

ϮϬϬ

)LJXUH:RUGQRUPDOL]DWLRQ

6NHZ GHWHFWLRQ DQG FRUUHFWLRQ DUH GRQH E\ WKH XVH RIKRUL]RQWDOSURMHFWLRQKLVWRJUDPVDFFRUGLQJWRHOHYHQ GLIIHUHQWDQJOHVRIURWDWLRQYDU\LQJIURPWRWKH FRUUHFWRU DQJOH RI LQFOLQH ZLOO EH WKH RQH KDYLQJ WKH GHQVHU KLVWRJUDP :KHQ ZH &DOFXODWH WKH HQWURS\ RI HDFKREWDLQHGKLVWRJUDPZHFDQGHWHUPLQDWHWKHPRUH GHQVH KLVWRJUDP UHSUHVHQWHG E\ WKH VPDOOHVW HQWURS\ )LJXUH LQGLFDWHV D UHGUHVVLQJ H[DPSOH RI RQH ZRUG WDNHQIURPWKHGDWDEDVH

ϭϱϬ QXPEHURI GHWHFWHG FODVV

ϭϬϬ

ϱϬ

Ϭ Ϭ

Ϭ͕ϭ

Ϭ͕Ϯ

Ϭ͕ϯ

Ϭ͕ϰ

Ϭ͕ϱ

Ϭ͕ϲ

Ϭ͕ϳ

9LJLODQFHSDUDPHWHUȡ

Ϭ͕ϴ

Ϭ͕ϵ

ϭ

)LJXUH1XPEHURIFODVVHVGHWHFWHGDFFRUGLQJWRYDULRXVYLJLODQFH SDUDPHWHU

2XU0/3SDUDPHWHUVDUH $QLQSXWOD\HUIRUPHGE\QHXURQVFRUUHVSRQGLQJ WR+XPRPHQWV $Q RXWSXW OD\HU FRPSRVHG RI QHXURQV UHSUHVHQWLQJWKHQXPEHURIFODVVHV 7ZRKLGGHQOD\HUVWKHILUVWRQHLVFRPSRVHGRI QHXURQHVDQGWKHVHFRQGRQHFRQWDLQVQHXURQV :HKDYHFKRVHQWKHVLJPRLGIXQFWLRQ

)LJXUH$UHGUHVVLQJH[DPSOH

:HKDYHWHVWHGIRXUDOJRULWKPVRI5XWRYLW]=KDQJ DQG6XHQ'HXWFKDQGWKHRQHRI=KDQJDQG:DQJ:H KDYH WDNHQ WKH RQH RI =KDQJ:DQJ DFFRUGLQJ WR LWV KLJK SHUIRUPDQFH VKRZ LQ )LJXUH ,PDJH

I QL

H QL

ZKHUH Q L LV WKH WRWDO LQSXW RI QHXURQ , JLYHQ E\ WKH ZHLJKWHG VXP RI LWV LQSXWVLJQDOV 7KH 5%) QHWZRUN FRQVLVWVRIWKUHHOD\HUVDQLQSXWOD\HUDKLGGHQOD\HU


DQGDQRXWSXWOD\HURIOLQHDUQHXURQV7KHUHDUHDWRWDO RI QRGHV LQ WKH KLGGHQ OD\HU 7KH LQSXW OD\HU LV FRPSRVHGRILQSXWQHXURQVUHSUHVHQWLQJWKHILUVW =HUQLNHPRPHQWVRIRUGHU

&RQFOXVLRQV

)LJXUH )X]]\ $57 0/3 5%) DQG )X]]\ $570/35%) FODVVLILHUDFFXUDF\

+DQGZULWWHQ $UDELF ZRUG UHFRJQLWLRQ LV VWLOO D YHU\ GLIILFXOWSUREOHP&ODVVLILHUFRPELQDWLRQLVFRQVLGHUHG DV D SURPLVLQJ ZD\ IRU VROYLQJ VXFK FRPSOH[ SDWWHUQ UHFRJQLWLRQSUREOHP:HKDYHVKRZQWKHHIILFLHQF\RI WKHSUHVHQWHGFRPELQLQJVFKHPHVRI)X]]\$570/3 DQG5%)QHWZRUNIRU$UDELFFXUVLYHZRUGUHFRJQLWLRQ 6R DOO WKH FRPELQDWLRQ DSSURDFKHV DUH VXSHULRU WR WKH EHVW LQGLYLGXDO FODVVLILHU DQG WKH PDMRULW\ YRWH RXWSHUIRUPV WKH RWKHU FODVVLILHU FRPELQDWLRQ VFKHPH E\JLYLQJDFFXUDF\UDWH +X DQG =HUQLNH PRPHQWV DUH LQYDULDQW WR WUDQVODWLRQURWDWLRQDQGVFDOLQJZKLFKRPLWWKHXVHRI VRPHSUHSURFHVVLQJRSHUDWLRQVOLNHQRUPDOL]DWLRQDQG VNHZ GHWHFWLRQ DQG FRUUHFWLRQ 7FKHELFKHI PRPHQWV DUHIDVWWRLPSOHPHQWSUHVHQWDGHTXDWHQRLVHWROHUDQFH DQG YHU\ DFFXUDWH LPDJH UHFRQVWUXFWLRQ 0/3V JHQHUDOO\ DFKLHYH JRRG SHUIRUPDQFHV LQ WHUPV RI FRUUHFW UHFRJQLWLRQ UDWH LQ KDQGZULWWHQ ZRUG FODVVLILFDWLRQ 7KH SHUIRUPDQFH RI 5DGLDO %DVLV )XQFWLRQ 1HXUDO 1HWZRUNV RQ FODVVLILFDWLRQ LV DOZD\V H[FHOOHQW FRPSDUHG ZLWK RWKHU QHWZRUNV &RQFHUQLQJ )X]]\ $57 QHWZRUN LW GRHV QRW GHPDQG D SULRUL NQRZOHGJHRIWKHIL[HGQXPEHURIQHFHVVDU\FODVVHV 7KHREWDLQHGUHVXOWVDUHSURPLVLQJDFFRUGLQJWRWKH QRYHOW\RIWKHLGHDLQVSLWHRIWKHSUREOHPVILQGLQJLQ WKH GDWD EDVH FRQFHUQLQJ WKH EDG ZULWLQJ $Q LQWHUHVWLQJ ZD\ WR LPSURYH WKH SHUIRUPDQFH RI WKH K\EULG5%)0/3)X]]\$57UHFRJQL]HUSUHVHQWHGLQ WKLVSDSHUFRQVLVWVLQDGGLQJRWKHUNLQGRIFODVVLILHUWR WKH FRPELQLQJ VFKHPH OLNH +00 FODVVLILHU $OVR ZH FDQ DGG D SRVWSURFHVVLQJ VWHS LQ RXU IXWXUH PRGLILFDWLRQVWRWKHV\VWHP

&RPSDULVRQZLWKRWKHU6\VWHPV

5HIHUHQFHV

7KH ,)1(1,7 GDWDEDVH LV DYDLODEOH WR WKH VFLHQWLILF FRPPXQLW\ DQG WKLV PDNHV V\VWHP FRPSDULVRQ SRVVLEOH $V PHQWLRQHG LQ WKH DEVWUDFW ZH FRPSDUHG WKHGHYHORSHGV\VWHPWRWKUHHRWKHUV\VWHPVWHVWHGDOVR RQ,)1(,1,7GDWDEDVHWKHRQHVRI>@LWPD\ EH QRWHG IURP 7DEOH WKDW WKH KLJKHVW DFFXUDF\ ZDV REWDLQHG E\ (O+DMM >@ WKLV LV GXH WR WKH XVH RI D VHJPHQWDWLRQ SKDVH RQ WKH RWKHU VLGH RXU V\VWHP DFKLHYHVDJRRGDFFXUDF\FRPSDUHGZLWK%XUURZ¶VDQG 0LOHG¶V>@V\VWHPZKLFKSURYHWKHSHUIRUPDQFHRI FRPELQLQJ DQ 5%) DQG 0/3 ZLWK D )X]]\ $57 QHWZRUN

>@ $]L]L 1 )DUDK 1 6HOODPL 1 DQG (QQDML $ ³8VLQJ 'LYHUVLW\ LQ &ODVVLILHU 6HW 6HOHFWLRQ IRU $UDELF +DQGZULWWHQ 5HFRJQLWLRQ´ LQ 3URFHHGLQJV RI 0XOWL &ODVVLILHU 6\VWHP /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH %HUOLQ SS >@ %XUURZ 3 ³$UDELF +DQGZULWLQJ 5HFRJQLWLRQ´ 5HSRUW RI 0DVWHU RI 6FLHQFH 6FKRRO RI ,QIRUPDWLFV8QLYHUVLW\RI(GLQEXUJKSS >@ &KHUJXL / DQG %HQPRKDPPHG 0 ³$57 1HWZRUN IRU $UDELF +DQGZULWWHQ 5HFRJQLWLRQ 6\VWHP´ LQ 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO $UDE &RQIHUHQFH RQ ,QIRUPDWLRQ 7HFKQRORJ\ 7XQLVLD >@ &KHULHW 0 .KDUPD 1 /LX & DQG 6XHQ & &KDUDFWHU 5HFRJQLWLRQ 6\VWHPV-RKQ :LOH\ DQG 6RQV86$ >@ 'XGD 5 +DUW 3 DQG 6WRUN ' 3DWWHUQ &ODVVLILFDWLRQ1HZW &ƵǌǌǇZd DĂũŽƌŝƚǇǀŽƚĞ

ϵϬ

^ƵŵͲƌƵůĞ DĂǆͲƌƵůĞ Z&

ϴϱ

ϴϬ ϭϬ

ϮϬ

ϯϬ

ϰϬ

ϱϬ

ϲϬ

ϴϬ

ϭϬϬ

1XPEHURIFODVV

7DEOH&RPSDULVRQUHVXOWV (O+DMM¶V 6\VWHP 0LOHG¶V 6\VWHP %XUURZ¶V 6\VWHP 2XU 6\VWHP

&ODVVLILHUV

&RPELQLQJ5XOH

$FFXUDF\

+00V

1HXUDO1HWZRUN

+00V

0DMRULW\9RWH

0DMRULW\9RWH

0DMRULW\9RWH

6HYHUDO .11 0/35%) )X]]\$57


>@ (O+DMM50RNEHO&DQG/LNIRUPDQ6XOHP/ ³&RPELQDWLRQRI+00%DVHG&ODVVLILHUVIRUWKH 5HFRJQLWLRQ RI $UDELF +DQGZULWWHQ :RUGV´ LQ 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ 'RFXPHQW $QDO\VLV DQG 5HFRJQLWLRQ 3DUDQD SS >@ )DUDK1.KDGLU0DQG6HOODPL0³$UWLILFLDO 1HXUDO 1HWZRUN )XVLRQ $SSOLFDWLRQ WR $UDELF :RUGV 5HFRJQLWLRQ´ LQ 3URFHHGLQJV RI (XURSHDQ 6\PSRVLXP RQ $UWLILFLDO 1HXUDO 1HWZRUNV%UXJHVSS >@ *RYLQGDUDMX9DQG6HWKXU6*XLGHWR2&5IRU ,QGLF 6FULSWV 'RFXPHQW 5HFRJQLWLRQ DQG 5HWULHYDO6SULQJHU1HZ@ *UDXSH ' 3ULQFLSOHV RI $UWLILFLDO 1HXUDO 1HWZRUNV:RUOG6FLHQWLILF6LQJDSRUH >@ +DLGO 0 DQG .LWWOHU - 0XOWLSOH &ODVVLILHU 6\VWHPV6SULQJHU*HUPDQ\ >@ .HFPDQ 9 /HDUQLQJ DQG 6RIW &RPSXWLQJ 6XSSRUW9HFWRU0DFKLQHV1HXUDO1HWZRUNVDQG )X]]\/RJLF0RGHOV7KH0,73UHVV86$ >@ .XQFKHYD / &RPELQLQJ 3DWWHUQ &ODVVLILHUV 0HWKRGV DQG $OJRULWKPV :LOH\,QWHUVFLHQFH 86$ >@ /LZLFNL 0 DQG %XQNH + 5HFRJQLWLRQ RI :KLWHERDUG 1RWHV 2QOLQH 2IIOLQH DQG &RPELQDWLRQ:RUOG6FLHQWLILF6LQJDSRUH >@ /RULJR/DQG*RYLQGDUDMX9³2II/LQH$UDELF +DQGZULWLQJ 5HFRJQLWLRQ D 6XUYH\´ ,((( RQ 3DWWHUQ $QDO\VLV DQG 0DFKLQH ,QWHOOLJHQFH YRO QRSS >@ 0LOHG+2OLYLHU&&KHULHW0DQG/HFRXUWLHU