Assisted Diagnosis of Cervical Intraepithelial Neoplasia (CIN)

Download PDF
37 downloads 52 Views 3MB Size Report
Comment
Abstract²This paper introduces an automated computer- assisted system for the diagnosis of CIN using ultra-large cervical histological digital slides. The system ...
!5(3/$&(7+,6/,1(:,7+@ &RPSDUHGWRWUDGLWLRQDOSDWKRORJ\DPDMRUDGYDQWDJHRIGLJLWDO SDWKRORJ\LVWKDWVOLGHVFDQEHDQDO\VHGXVLQJVRIWZDUHUDWKHU WKDQ OLPLWHG PDQXDO DQDO\VLV > @ $ GLJLWDO VOLGH LV D KLJK UHVROXWLRQ VFDQ RI D PLFURVFRSH WLVVXH VDPSOH $ W\SLFDO FHUYLFDO KLVWRORJLFDO VOLGH ZKLFK KDV D WLVVXH DUHD RI PPîPPLVVFDQQHGWRJLYHDQLPDJHRIî SL[HOV RU *% >@ RI XQFRPSUHVVHG FRORXU LPDJH GDWD $Q H[DPSOHRIDGLJLWDOVOLGHFDQEHVHHQLQ)LJ ,Q UHFHQW UHVHDUFK LQ GLJLWDO SDWKRORJ\ VWXGLHV >@ LQYHVWLJDWHWKHTXDOLWLHVRIVFDQQHGGLJLWDOVOLGHVFRPSDUHGZLWK WUDGLWLRQDO JODVV VOLGHV 2WKHU VWXGLHV DUH RQ YLHZLQJ GLJLWDO VOLGHVVXFKDVIRUHGXFDWLRQ>@DQGWHOHSDWKRORJ\>@ 7KHDQDO\VLVRIGLJLWDOVOLGHVLVVWLOODWDSUHOLPLQDU\VWDJHZLWK LQYHVWLJDWLRQVRQ7LVVXH PLFURDUUD\V 70$V >@DV ZHOO DVWKHDQDO\VLVRIZKROHVOLGHV>@ ,QWKLVVWXG\ZHSUHVHQWRQHRIWKHILUVWPDMRULQYHVWLJDWLRQV LQWR WKH DQDO\VLV RI GLJLWDO VOLGHV E\ SURSRVLQJ DQ DXWRPDWHG V\VWHP IRU WKH GLDJQRVLV RI &,1 XVLQJ GLJLWDO VOLGHV 7KH SURSRVHG V\VWHP FRQWDLQV WZR SKDVHV WKH VHJPHQWDWLRQ RI VTXDPRXVHSLWKHOLXPDQGWKHGLDJQRVLVRI&,1 ,, 0

8 c    k6 

*ODVVVOLGHVZHUHVFDQQHGDW;REMHFWLYHPDJQLILFDWLRQ D UHVROXWLRQ RI  PSL[HO  XVLQJ DQ $SHULR 6FDQ6FRSH &6 VFDQQHUDQGDUFKLYHGLQELWFRORXU-3(*IRUPDW%DVHGRQ DYDLODEOHGLJLWDOVOLGHVWKHVL]HVRIVFDQQHGVOLGHVYDU\DQG DUHXSWR*%RIXQFRPSUHVVHGGDWDZKLFKUHIOHFWVDUHJLRQ RI PPîPP RI D JODVV VOLGH $OO  VOLGHV ZHUH GLDJQRVHG UHJLRQ E\ UHJLRQ E\ RQH SDWKRORJLVW  RI WKHP ZHUHGLDJQRVHGE\WZRSDWKRORJLVWVLQGHSHQGHQWO\ )RU WKH VHJPHQWDWLRQ RI VTXDPRXV HSLWKHOLXP D UHJLRQEDVHG PXOWLUHVROXWLRQ WH[WXUH FODVVLILFDWLRQ PHWKRG LV XVHG *LYHQ WKH ODUJH QDWXUH RI GLJLWDO VOLGHV LW LV YHU\ WLPH FRQVXPLQJWRGRVHJPHQWDWLRQDWWKHPD[LPXPUHVROXWLRQ ; PDJQLILFDWLRQ  2XU VWUDWHJ\ LV WKHUHIRUH WR GR DQ LQLWLDO EORFNEDVHGFRDUVHVHJPHQWDWLRQDWDORZUHVROXWLRQDQGWKHQ ILQHWXQHWKHERXQGDU\EORFNVDWDKLJKHUUHVROXWLRQ 7KLVLPPHGLDWHO\UDLVHVWZRLVVXHVWREHLQYHVWLJDWHGZKDWLV WKHEHVWUHVROXWLRQDQGEORFNVL]HERWKIRUFRDUVHVHJPHQWDWLRQ DQG IRU ERXQGDU\ WXQLQJ 7KHVH SDUDPHWHUV DUH LPSRUWDQW IRU UHGXFLQJ SURFHVVLQJ WLPH ZKLOH UHWDLQLQJ WKH TXDOLW\ RI

!5(3/$&(7+,6/,1(:,7+@DQG KDV EHHQ GHYHORSHG IXUWKHU VLQFH WKHQ ,W LV D UREXVW OHDUQLQJ PDFKLQHIRUWZRRUPRUHFDWHJRU\FODVVLILFDWLRQSUREOHPV)RU FODVVLILFDWLRQLQWRWZRFDWHJRULHV690VROYHVWKHSUREOHPRI REWDLQLQJWKHRSWLPDOERXQGDU\K\SHUSODQHZKLFKVHSDUDWHVWKH IHDWXUHYHFWRUVRIWKHWZRFDWHJRULHV7KHEDVLFLGHDRI690LV WRORFDWHWKHERXQGDU\ZKLFKLVPRVWGLVWDQWIURPWKHQHDUHVW YHFWRUVRIERWKRIWKHWZRFDWHJRULHV 7RFODVVLI\LQWRRXUILYHFDWHJRULHVXVLQJ690DKLHUDUFK\ RI IRXU ELQDU\ FODVVLILFDWLRQV LV LGHQWLILHG 7KHVH IRXU ELQDU\ 690FODVVLILFDWLRQVXVHGLIIHUHQWVHWVRIWH[WXUHIHDWXUHV7KH RSWLPDO VHW RI IHDWXUHV IRU HDFK FODVVLILHU LV VHOHFWHG E\ V\VWHPDWLF WHVWLQJ RQ WKH WHVW GDWD VHW 7KH GLIIHUHQWLDWLRQ EHWZHHQ EDFNJURXQG DQG WLVVXH FRPSRQHQW RQO\ QHHGV 

rs(t

IHDWXUHV QDPHO\ P  V  5  8  H  )uvw

‰Š(‹

 )Œ$Ž

DQG

‰Š(‹ ‰Š(‹ ƒ „(… ƒ„(… )† ‡ˆ )  )Œ $Ž DQG )† ‡ˆ DUH FDOFXODWHG ZLWK WKHLU

*/&0 RIIVHWV LQ WKH KRUL]RQWDO GLUHFWLRQ RQO\  7KH RWKHU  ELQDU\FODVVLILFDWLRQVQHHGDOOWH[WXUHIHDWXUHV %LQDU\FODVVLILFDWLRQRIEDFNJURXQGDQGWLVVXHLVSHUIRUPHG ILUVW 7KHQ WLVVXH LV VXEFODVVLILHG DV HLWKHU VTXDPRXV HSLWKHOLXPRUVWURPD7KHUHVXOWLQJVTXDPRXVHSLWKHOLXPPD\ FRQWDLQ VRPH FROXPQDU HSLWKHOLXP DQGRU 5%&V DQG VR WZR ILQDOFODVVLILFDWLRQVLGHQWLI\FROXPQDUHSLWKHOLXPDQG5%&V 7KH SRSXODU /LE690 >@ WRRO LV XVHG WR SHUIRUP 690 FODVVLILFDWLRQV ZLWK WKH ZLGHO\ XVHG *DXVVLDQ 5%) NHUQHO 7KHUH DUH WZR SDUDPHWHUV WR EH GHFLGHG WR JHW RSWLPLVHG VXSSRUWYHFWRUVWKHSHQDOW\SDUDPHWHU & IURPWKHVRIWPDUJLQ

!5(3/$&(7+,6/,1(:,7+ŸEžE£ «œ3¬£¦1§nšŸ›¬=œ=¥žž   ô £ ž3ž1ªõ¡  ó  ¬=šœ £"œ3  ¡žE£ "0EH[2 ' $FF )1$FF )3 )3 f3- O P 45 0 -"ë P4 P ë. 5 ` - 2 O- 5 ë j E 2 5 E 2 5 4 ` 3 f  ` Pj 5 ` P 5ë 2E- 5 POP2 5 0. O4 . 5 Pjj f3-(. P 0. 5 4 . P 45 . P 5 5 E 2 5 3 f ) ë P 5 ën2 O - 5 j3O Pj 5 4 5  0 0 5 0E-)ë2 ë ë 3 f Pj 5 j3O Pj 5 P `0 2E5 .. 5 ëë f3- j P ë25 O 0ë P - 55 -- O  P j P E 2 5 4 5 E 2 5 ëf = . ë P . 54 Pjë 5 5 P O0nO 5 2j3P 5 P f 0E2 P ` 5 O. 2 P j E 2 5 5 0 5 0 E 2 50 ` f ë ë P 5 2 O5 4 P 5 P 0n5 O 0ë 0*0 ' 0n- 5 0 ëP . ë C 5 P 5 0 O 2E- 5 j3PO 0n5 POO 5P 0 P . 55 04 O  54 0n5 2E5 2=0 2E5 2=0

)1 -

5 0O O 0n5 j3P 2E- 5 5 00 2E- 5 `P 0 5 2 2E5 P4 PO 0n- 5 j - 52 ë 54 2E5 2

 DUHGRZQVDPSOHGWREHîSL[HOVDW;PDJQLILFDWLRQ$V EHIRUHWKH\DUHFODVVLILHGWREHHLWKHUFROXPQDUHSLWKHOLXPRU VTXDPRXVHSLWKHOLXP )LJ J    6WHS6TXDPRXV(SLWKHOLXPYV5%&VDW; 6LPLODUWRVWHSWKHVHJPHQWHGVTXDPRXVHSLWKHOLXPIURP VWHS  DUH SURFHVVHG WR LGHQWLI\ 5%&V %ORFNV DW ; DUH GRZQVDPSOHGWREHîSL[HOVDW;$QH[DPSOHLVVKRZQ LQ)LJ K    6WHS5HPRYH0LVFODVVLILFDWLRQV 7KH WH[WXUHEDVHG VHJPHQWDWLRQ FDQ RFFDVLRQDOO\ JLYH HUURQHRXVUHVXOWVEHFDXVHRIPLVFODVVLILFDWLRQV6RPHRIWKHVH µURJXH¶EORFNVFDQEHLGHQWLILHGDQGUHFODVVLILHGXVLQJPHGLFDO SDWKRORJ\UXOHVVXFKDV x ,VRODWHG WLVVXH EORFNV VXUURXQGHG E\ EDFNJURXQG DUH FRQYHUWHGWREDFNJURXQG x 7LVVXHVXUURXQGHG LVRODWHG EDFNJURXQG EORFNV DUH FRQYHUWHGWRWLVVXH x 6PDOO UHJLRQV RI VTXDPRXV HSLWKHOLXP VXUURXQGHG E\ EDFNJURXQGQRQVTXDPRXVHSLWKHOLXPWLVVXHDUHUHSODFHG E\WKHLUVXUURXQGLQJPDWHULDO x 6PDOO UHJLRQV RI QRQVTXDPRXV HSLWKHOLXP WLVVXH VXUURXQGHG E\ EDFNJURXQGVTXDPRXV HSLWKHOLXP DUH UHSODFHGE\WKHLUVXUURXQGLQJPDWHULDO 7KHDSSOLFDWLRQRIWKHVHUXOHVLVLOOXVWUDWHGLQ)LJ L 

* 5HVXOWVDQG$QDO\VLV   *URXQG7UXWK,PDJH'DWD )RUPHDVXULQJWKHUREXVWQHVVRIVHJPHQWDWLRQJURXQGWUXWK LPDJHV *7  DUH DFTXLUHG IURP PDQXDO VHJPHQWDWLRQ ZKHUH ERXQGDU\ EORFNV DUH DOVR UHJDUGHG DV VTXDPRXV HSLWKHOLXP 8QGHUWKHVXSHUYLVLRQRISDWKRORJLVWVPDQXDOVHJPHQWDWLRQLV SHUIRUPHG E\ GUDZLQJ UHJLRQV XVLQJ $SHULR¶V ,PDJH6FRSH VRIWZDUH ,QWKLVDSSOLFDWLRQZHFKRRVHWKHIROORZLQJPHDVXUHPHQWV WRLQGLFDWHKRZJRRGWKHSURSRVHGVHJPHQWDWLRQPHWKRGLV





C žón¯ ž1ª8¬=š¬3  §Eª>ŸEžE£ «œ3¬£¦1§nŸš›¬=œ=¥žž  -  -ô «nª£ž3ž1ªõ¡  ó  ¬=šœ £"œ3  ¡žE£ "H[' "H[' $FF )1ë $FF )1 )3 )3 . ) . - ë- ` 2 P ë 5 `E. O- 5 P 2 Pë 2j P ë. 5 `P 4 E 2 5 5 - 5j 210 P ` 5 .3. 24 P 5 0n. 5 P4 PP - 5` j - 5 j3O2 2 `O Pë5 O - 55 P4jë4 P P P 5 4 2  0 5 0 5 5 j  ` . `  ` ` 2. P 5P 2 P. -32 P 5 0E4 5 5 5 E 2 5 0 . 2 P 45 232 Pj 5 P 5 -2 2E- 5 2 2E5 j . 5 O 4ë  * ' ` . ` 2 jj 5 4 C 5 P 5 0 ë 0 5 j 5 2=0 50 ë 50  2E5 2 2E5 2 2E5 2





! '($, &—;3Fî+# 9# & ),Zi, # +3'âf3-). "Yîf=-). ;3F—& A'a # ï(' m -(.# 9 5 O 5 `-(C. ')9=H[%E'"# b& '), &  # ;=í XYCL$& '"Hði')9=H['"& "& # ;=>! '($, & S "Yñ ò M, (@ LV XVHG WR GHDO ZLWK WKLV GDWD LPEDODQFH SUREOHP $IWHU RYHUVDPSOLQJ WKH GDWD VHW IRU WKH WUDLQLQJFRQWDLQV  u   SHUSHQGLFXODUOLQHV



3546)789 : ;=268?'@"A%B?45C DC DEF4GH8GIA0@"?=845FJKC 45ED@IGBC F=F4IB8E@"?)L ;',   MNO)P*+ . . 0Q) )P R *%9 ;S9 TUNV*+ . . O UWR *%9 ;S9 9 UO.Q'*+ . . PP. X0QR *%9 ;S9 9 9 QMNV*+ . . QT R 35!  OUP2*+ . . PXXR

   7HVW6WUDWHJLHV 7KH FKRVHQ WHVW VWUDWHJLHV VKRXOG EH DEOH WR UHIOHFW WKH IROORZLQJ WKUHH W\SHV RI GDWD GLIIHUHQFHV ZKHQ VHOHFWLQJ WKH 690WUDLQLQJVHWDQGWHVWLQJVHW7KHW\SHVRIGLIIHUHQFHDUH ,EHWZHHQOLQHVWDNHQIURPWKHVDPHGLJLWDOVOLGH ,, EHWZHHQ OLQHV WDNHQ IURP GLIIHUHQW VOLGHV EXW IURP WKH VDPHEDWFK ,,,EHWZHHQOLQHVWDNHQIURPGLIIHUHQWVOLGHVDQGEDWFKHV $V VXPPDULVHG LQ >@ SRSXODU WHVW VWUDWHJLHV DUH NIROG FURVVYDOLGDWLRQ WKH XVH RI VHSDUDWH WUDLQLQJ DQG WHVWLQJ VHWV DQGQRWXVLQJDVHSDUDWHHYDOXDWLRQVHW,QWKLVVWXG\ZHXVHWKH ODWHUWZRWHVWVWUDWHJLHVLQRUGHUWRUHYHDOWKHDERYHPHQWLRQHG WKUHHW\SHVRIGDWDGLIIHUHQFHVµ1RWXVLQJDVHSDUDWHHYDOXDWLRQ VHW¶PHDQVWKHWUDLQLQJDQGWHVWLQJGDWDFDQEHIURPWKHVDPH GLJLWDOVOLGHZKLFKFRXOGEHXVHGWRWHVWWKH7\SH,'LIIHUHQFH 7\SH,,DQG,,,'LIIHUHQFHVFDQEHWHVWHGXVLQJVHSDUDWHWUDLQLQJ DQG WHVWLQJ VHWV ,I WKH WUDLQLQJ DQG WHVWLQJ VHWV DUH IURP WKH VDPH EDWFK 7\SH ,, GLIIHUHQFH LV WHVWHG ZKHUHDV LI WKH\ DUH WDNHQIURPGLIIHUHQWEDWFKHV7\SH,,,'LIIHUHQFHFDQEHWHVWHG 7KHUHIRUHWKHIROORZLQJWHVWVWUDWHJLHVDUHGHVLJQHG x7HVW 6WUDWHJ\ , -&  VHOHFW D VXEVHW RI Q SHUSHQGLFXODU OLQHV IURP DOO  VOLGHV IRU 690 WUDLQLQJ 7KH UHPDLQLQJ Q  OLQHV DUH XVHG IRU WHVWLQJ 7KLV WHVWVWUDWHJ\UHIOHFWV7\SH,'LIIHUHQFH x7HVW6WUDWHJ\,, -& VHOHFWDVXEVHWRIQOLQHVIURP GLJLWDOVOLGHV IURPEDWFK-DQGIURPEDWFK& IRU WUDLQLQJ 7KH UHPDLQLQJ Q  OLQHV DUH XVHG IRU WHVWLQJ7KHVHWHVWLQJOLQHVDUHWDNHQIURPVOLGHV IURP EDWFK-DQGIURPEDWFK& ZKLFKDUHQRWXVHGIRU690 WUDLQLQJ7KLVVWUDWHJ\UHIOHFWV7\SH,,'LIIHUHQFH x7HVW 6WUDWHJ\ ,,, -  VHOHFW D VXEVHW RI Q OLQHV RQO\ WDNHQIURPWKHVOLGHVLQEDWFK-7KHVHQOLQHVDUHXVHG IRUWUDLQLQJ7KHUHPDLQLQJ Q OLQHVDUHWDNHQIURP WKHGLJLWDOVOLGHVIURPEDWFK&DQGDUHXVHGIRUWHVWLQJ 7KLVWHVWVWUDWHJ\UHIOHFWV7\SH,,,'LIIHUHQFH   &ODVVLILFDWLRQRI3HUSHQGLFXODU/LQHV 0XOWLFDWHJRU\ 690 XVHV WKH 5%) NHUQHO IRU WKLV WDUJHWHG FODVVLILFDWLRQWDVN7KH/LE690WRROLVXVHG690SDUDPHWHUV & DQG J DUH REWDLQHG XVLQJ JULGVHDUFK FURVVYDOLGDWLRQV IRU WKHSHUSHQGLFXODUOLQHIHDWXUHVIRUDOOWKHWKUHHWHVWVWUDWHJLHV )RXUSDLUVRI&DQG J DUHREWDLQHGIURPWKHFURVVYDOLGDWLRQ IRUWKHWUDLQLQJRIIRXULQGHSHQGHQWVXSSRUWYHFWRUV8VLQJWKH FURVVYDOLGDWLRQ DFFXUDFLHV $FF&9û IURP HDFK RI WKH IRXU LQGHSHQGHQWPHDVXUHPHQWVDVZHLJKWVDSHUSHQGLFXODUOLQHLV WKHQ FODVVLILHG XVLQJ D FRPELQDWLRQ RI WKH SRVWHULRU SUREDELOLWLHV 3UREü L IURP 690 SUHGLFWLRQV DQG $FF&9ý  7KH SHUSHQGLFXODU OLQH LV WKHQ FODVVLILHG WR EH WKH FDWHJRU\ ZKLFKDFKLHYHVWKHKLJKHVWYDOXHLQ

!5(3/$&(7+,6/,1(:,7+@ )RU DOO WKH WKUHH WHVW VWUDWHJLHV WKH SHUSHQGLFXODU OLQH IHDWXUHV DUH FODVVLILHG DQG FRPSDUHG ZLWK 3DWKRORJLVW $¶V PDQXDOFODVVLILFDWLRQUHVXOWV 5HVXOWV 7DEOH9, VKRZWKDWZKHQWHVWLQJVDPSOHVDUHIURP WKHVDPHVHWRIVOLGHVDVWKHWUDLQLQJVHWWKRXJKXVLQJGLIIHUHQW OLQHV ^_ ` _ DQGa b FROXPQVRI7DEOH9, H[FHOOHQWUHVXOWVDUH REWDLQHGZLWKFRUUHVSRQGLQJDFFXUDFLHVFORVHWRDQGDOO .DSSD YDOXHV FORVH WR  H[FHOOHQW DJUHHPHQW  :KHQ WHVWLQJ OLQHVFRPHIURPGLIIHUHQWGLJLWDOVOLGHVEXWWKHVDPHEDWFK a b  FROXPQ RI 7DEOH 9,  WKH DFFXUDF\ YDOXH GURSV WR  XQZHLJKWHG .DSSD EHFRPHV SRRU DJUHHPHQW   DQG TXDGUDWLF ZHLJKWHG .DSSD EHFRPHV IDLU WR JRRG DJUHHPHQW )LQDOO\ZKHQWHVWLQJSHUSHQGLFXODUOLQHVIURPGLIIHUHQWEDWFKHV ODVW FROXPQ RI 7DEOH 9,  WKH DFFXUDF\ YDOXH ZRUVHQV WR EH XQZHLJKWHG .DSSDJHWSRRUDJUHHPHQW  DQG TXDGUDWLFZHLJKWHG.DSSDJHWVIDLUWRJRRGDJUHHPHQW :HFRQFOXGHWKDWWKHFODVVLILFDWLRQRISHUSHQGLFXODUOLQHVLV UREXVWLIWKHOLQHVIRUWHVWLQJDUHUHSUHVHQWDWLYHRIVDPSOHVIURP

9 99 999



3546)78+: VFF@ FDQ EH D ORW ORZHU WKDQ WKH .DSSD   ,QWHU2EVHUYHU9DULDELOLW\ YDOXHV IRU HQWLUH GLJLWDO VOLGHV 6WXG\ >@ UHSRUWV WKH RYHUDOO 2QHDSSOLFDWLRQRIRXUDXWRPDWLFGLDJQRVLVV\VWHPLVWRXVHLW XQZHLJKWHG .DSSD WR EH  DQG  PHDVXULQJ HQWLUH DV D VWDQGDUG IRU FRPSDULQJ WKH GLDJQRVHV IURP GLIIHUHQW GLJLWDOVOLGHVZKHUHDVWKHVPDOOHVWRYHUDOOXQZHLJKWHG.DSSD SDWKRORJLVWV LQWHUREVHUYHU YDULDELOLW\  ± RU HYHQ FRPSDULQJ LQ7DEOH9,,,LVPHDVXULQJUHJLRQDOGLDJQRVLV WKH SHUIRUPDQFH RI WKH VDPH SDWKRORJLVW DW GLIIHUHQW WLPHV :KHQ FRPSDULQJ WKH LQWHUREVHUYHU YDULDELOLW\ IURP WKH LQWUDREVHUYHU YDULDELOLW\  :H KDYH H[SHULPHQWHG ZLWK WKH UHVXOWVLQWKH^_ a b a b a b DQGa b FROXPQVLQ7DEOH9,,,ZLWK IRUPHURIWKHVHWZRSRVVLELOLWLHV 7DEOH 9,, RYHUDOO XQZHLJKWHG .DSSD DOO DFKLHYH SRRU $SUHYLRXVVWXG\>@PHDVXUHGWKHLQWHUREVHUYHUYDULDELOLW\ DJUHHPHQW DQG 7KHRYHUDOOTXDGUDWLF .DSSD LQ WKH GLDJQRVLV RI &,1 ,W GLG WZR URXQGV RI WHVWV RYHU  YDOXHLQ7DEOH9,, H[FHOOHQWDJUHHPHQW LVEHWWHUWKDQ ELRSVLHVZLWKH[SHULHQFHGSDWKRORJLVWV5HVXOWVVKRZHGSRRU LWVFRUUHVSRQGLQJHQWU\LQ7DEOH9,,, IDLUWRJRRGDJUHHPHQW DJUHHPHQW ZLWK XQZHLJKWHG .DSSD RI  DQG  DQG  +RZHYHUZLWKPRUHVOLGHVIURPGLIIHUHQWEDWFKHVIRU H[FHOOHQWTXDGUDWLFZHLJKWHG.DSSDRIDQG:KHQ WUDLQLQJ WKH V\VWHP GLDJQRVLV PLJKW KDYH WKH SRWHQWLDO WR ORRNLQJ DW LQGLYLGXDO XQZHLJKWHG .DSSD H[FHSW IRU &,1 ,,, DGGUHVVWKHSUREOHPRILQWHUREVHUYHUYDULDELOLW\ ZKLFK DFKLHYHG IDLU WR JRRG DQG H[FHOOHQW DJUHHPHQW  DOOWKHRWKHUFDVHV 1RUPDO&,1,DQG&,1,,  f%;'*%y}'19 f%; 9 &  SURGXFHGSRRUDJUHHPHQW 7KH WUDGLWLRQDO ZD\ RI GLDJQRVLQJ &,1 LV VXEMHFWLYH 7KH  GLJLWDO VOLGHV IURP EDWFK& ZHUH GLDJQRVHG DQG UHVXOWLQJ LQ JUHDW LQWHULQWUDREVHUYHU YDULDELOLW\ DQG SRRU PDUNHGE\WKHWZRSDWKRORJLVWVVHSDUDWHO\7KHLULQWHUREVHUYHU UHSURGXFLELOLW\:LWKWKHXVHRIKLJKUHVROXWLRQVOLGHVFDQQLQJ YDULDELOLW\ IRU SHUSHQGLFXODU OLQHV LV PHDVXUHG ZLWK UHVXOWV VKRZQLQ7DEOH9,,7KHILJXUHVLQWKHGLDJRQDOOLQHRIWKHWDEOH GHYLFHVXOWUDODUJHFRPSOH[FHUYLFDOKLVWRORJLFDOVOLGHVFDQEH VKRZ FRPSOHWH DJUHHPHQW EHWZHHQ WKH WZR SDWKRORJLVWV IRU SUHVHQWHG LQ GLJLWDO IRUP ,Q WKLV SURMHFW WKH IHDVLELOLW\ DQG SHUSHQGLFXODUOLQHV  :KHQFRQVLGHULQJ .DSSD SURFHVV RI GHVLJQLQJ DQG GHYHORSLQJ D FRPSXWHU DVVLVWHG IRUHDFKGLDJQRVWLF JURXS1RUPDODQG&,1,,,FDVHVDFKLHYH V\VWHPIRUWKHGLDJQRVLVRI&,1XVLQJKLVWRORJLFDOGLJLWDOVOLGHV IDLUWRJRRGXQZHLJKWHG.DSSDYDOXHV ZLWK.DSSDYDOXHVRI LVLQYHVWLJDWHG 7KLVSDSHUKDVGHVFULEHGWKHILUVWUHSRUWHGPDMRUVWXG\LQWR DQG&,1,DQG&,1,,FDVHVJHWSRRUDJUHHPHQW WKHDXWRPDWLFFODVVLILFDWLRQRI&,1DQGWKHILUVWUHSRUWHGZRUN DQG  LQWKHVHJPHQWDWLRQRI52,VIURPFRPSOH[KLVWRORJLFDOVFHQHV   'LDJQRVLVRI&,1 XVLQJ XOWUDODUJH GLJLWDO VOLGHV $ QRYHO PHWKRG IRU WKH 7KH UREXVWQHVV RI WKH GLDJQRVLV RI &,1 LV PHDVXUHG XVLQJ GLDJQRVLVRI&,1ZDVGHYHORSHG7KLVPHWKRGLVEDVHGRQWKH DFFXUDF\ XQZHLJKWHG .DSSD DQG TXDGUDWLF ZHLJKWHG .DSSD )RU DOO WKUHH WHVW VWUDWHJLHV V\VWHP GLDJQRVHV DUH FRPSDUHG FODVVLILFDWLRQ RI OLQH IHDWXUHV WR FODVVLI\ SURJUHVVLRQ RI &,1 ZLWKERWKSDWKRORJLVWV¶GLDJQRVHVZKHUHDYDLODEOH5HVXOWVDUH FKDUDFWHULVWLFVWKURXJKVTXDPRXVHSLWKHOLXP 7KLVLVDOVRWKHILUVWUHSRUWHGZRUNWRTXDQWLWDWLYHO\PHDVXUH VKRZQLQ7DEOH9,,, 3546)78+:V9 9 9 s . .l,  !  V. ,l . j }2 v (ÿ k! .-2%‚/ƒƒI‚ Œ -,l ! ÿ d%‚/ƒƒI‚



g+8G/ÿ oPHUUUr ,  o H ,l ±}E ÿ t ,l ÿ ! jm|j! =ÍV ±, .( ÿ t .-q! k ±kc - , . ÿ ñs .  ,̐ H! k jä ,  Œ     }2E ÿ t ,l ÿ ! jmi+   .l! m} ×' 3m ÿ =QXXN ÍVQ ÿ +H, , !  j '1 .( ÿ )y5 . ! ,  , ÿ  ! k jTÿ  ! k á1HkqϏs .3- ÿ ) ÿ  ß -ás - ÿ . e/) ÿ  ./m }2E ÿ t ,l ÿ ! jó*%   Ïc2& ÿ m9 , . -~Q Í ÿ S, . . ,l k ÿ ! , .l! @ÿ  - v k t ÿ , !  = ÿ -B ÿ   s H  j ÿ /m+, k ! $, ÿ ½l! 3- ÿ ./m .u  . , Eÿ o ! k-n . v . V .nlk,  ! ÿ ! ,  ,l  gd;=ó, ! ( ÿ Ç(H(- v m

!  ÿ  H-2! ,5  , . ÿ l!   )üú  ýûºþqýûÿ±, . (ÿ t .-p! k iæ- ,  ÿ º*% ÿ ÿ .  s .-ÿ (ÿ  ' , ó1k H ÿ"s .-3ÿ . "}2Eÿ t ,l ÿ ! jm"3I (ÿ j m 1k H ÿ m*dEk ÿ  mÿ ~PHUN 1k ÿ 5H, , !  jV d),  ./," ! k jV !)1k H ÿ s- ,  p  ÍVlE ÿ !  m i+ k  s .3- ÿ .  9 t .l!  !*%m.y! - m03I( ÿ j m1k H ÿ m0*dE k ÿ  01k dk . &   v , E( ÿ ÿ  ÿ  ÿ . - ÿ  ÿ  ÿ  P UTX