Automatic Learning and Generation of Social ... - MIT Media Lab

16 downloads 307 Views 377KB Size Report
May 15, 2009 - social interaction. Categories and Subject Descriptors. I.2.8 [Artificial Intelligence]: Problem Solving, Control. Methods, and Search – plan ...
$XWRPDWLF/HDUQLQJDQG*HQHUDWLRQRI6RFLDO%HKDYLRU IURP&ROOHFWLYH+XPDQ*DPHSOD\ -HII2UNLQ

'HE5R\

0DVVDFKXVHWWV,QVWLWXWHRI7HFKQRORJ\ 0HGLD/DERUDWRU\ &DPEULGJH0DVVDFKXVHWWV86$ MRUNLQ#PHGLDPLWHGX

0DVVDFKXVHWWV,QVWLWXWHRI7HFKQRORJ\ 0HGLD/DERUDWRU\ &DPEULGJH0DVVDFKXVHWWV86$ GNUR\#PHGLDPLWHGX

  $%675$&7 &XUUHQWDSSURDFKHVWRDXWKRULQJEHKDYLRUDQGGLDORJXHIRUDJHQWV WKDW LQWHUDFW ZLWK KXPDQV LQ YLUWXDO HQYLURQPHQWV DUH ODERU LQWHQVLYH \HW RIWHQ \LHOG OHVV UREXVW UHVXOWV WKDQ GHVLUHG LQ WKH IDFH RI WKH LQFUHGLEOH YDULDQFH SRVVLEOH LQ KXPDQ LQSXW 7KH JURZLQJ QXPEHU RI SHRSOH SOD\LQJ PXOWLSOD\HU JDPHV RQOLQH SURYLGHV D SRWHQWLDOO\EHWWHUDOWHUQDWLYHWRKDQGDXWKRUHGFRQWHQW ± FDSWXULQJ EHKDYLRU DQG GLDORJXH IURP KXPDQKXPDQ LQWHUDFWLRQV DQG DXWRPDWLQJ DJHQWV ZLWK WKLV GDWD 7KLV SDSHU GRFXPHQWV SURPLVLQJ UHVXOWV IURP WKH ILUVW LWHUDWLRQ RI D &ROOHFWLYH $UWLILFLDO ,QWHOOLJHQFH V\VWHP WKDW JHQHUDWHV EHKDYLRU DQG GLDORJXH LQ UHDOWLPH IURP GDWD FDSWXUHG IURP RYHU  SOD\HUVRI7KH5HVWDXUDQW*DPH:HILUVWGHVFULEHWKHJDPHWKH FROOHFWLYHPHPRU\V\VWHPDQGWKHSURSRVDOFULWLTXHGULYHQDJHQW DUFKLWHFWXUH DQG WKHQ GHPRQVWUDWH TXDQWLWDWLYHO\ WKDW RXU V\VWHP SUHVHUYHV WKH WH[WXUH RU PHDQLQJIXO ORFDO FRKHUHQFH RI KXPDQ VRFLDOLQWHUDFWLRQ

&DWHJRULHVDQG6XEMHFW'HVFULSWRUV , >$UWLILFLDO ,QWHOOLJHQFH@ 3UREOHP 6ROYLQJ &RQWURO 0HWKRGV DQG 6HDUFK ± SODQ H[HFXWLRQ IRUPDWLRQ DQG JHQHUDWLRQ *HQHUDO7HUPV $OJRULWKPV0HDVXUHPHQW'HVLJQ([SHULPHQWDWLRQ .H\ZRUGV 6RFLDO %HKDYLRU 1DWXUDO /DQJXDJH 'LDORJXH /HDUQLQJ &RPSXWHU*DPHV  ,1752'8&7,21 &XUUHQWDSSURDFKHVWRDXWKRULQJEHKDYLRUDQGGLDORJXHIRUDJHQWV WKDW LQWHUDFW ZLWK KXPDQV LQ YLUWXDO HQYLURQPHQWV DUH ODERU LQWHQVLYH \HW RIWHQ \LHOG OHVV UREXVW UHVXOWV WKDQ GHVLUHG LQ WKH IDFH RI WKH LQFUHGLEOH YDULDQFH SRVVLEOH LQ KXPDQ LQSXW )HZ JDPHVRUWUDLQLQJVLPXODWLRQVDOORZRSHQHQGHGQDWXUDOODQJXDJH GLDORJXH LQSXW 7KH JURZLQJ QXPEHU RI SHRSOH SOD\LQJ PXOWLSOD\HUJDPHVRQOLQHSURYLGHVDSRWHQWLDOO\EHWWHUDOWHUQDWLYH

 )LJXUH6FUHHQVKRWIURP7KH5HVWDXUDQW*DPH 

WRKDQGDXWKRUHGFRQWHQW±FDSWXULQJEHKDYLRUDQGGLDORJXHIURP KXPDQKXPDQLQWHUDFWLRQVDQGDXWRPDWLQJDJHQWVZLWKWKLVGDWD 7KLV &ROOHFWLYH $UWLILFLDO ,QWHOOLJHQFH DSSURDFK HPSRZHUV DJHQWV ZLWK VKDUHG PHPRULHV VSDQQLQJ WKH ZLGH UDQJH RI ODQJXDJH DQG EHKDYLRU IRXQG LQ KXPDQ LQWHUDFWLRQV &ROOHFWLYH ,QWHOOLJHQFH UHIHUV WR WKH SKHQRPHQRQ ZKHUH D ODUJH QXPEHU RI RUGLQDU\ SHRSOHFROOHFWLYHO\PDNHEHWWHUGHFLVLRQVWKDQDVPDOOQXPEHURI H[SHUWV 6LPLODUO\ &ROOHFWLYH $UWLILFLDO ,QWHOOLJHQFH UHIHUV WR FDSWXULQJGDWDIURPDODUJHQXPEHURIRUGLQDU\SOD\HUVLQRUGHUWR SURGXFHEHKDYLRUDQGGLDORJXHPRUHUREXVWWKDQFDQEHDXWKRUHG E\DVPDOOQXPEHURIVNLOOHGGHVLJQHUVRUHQJLQHHUV ,Q SUHYLRXV ZRUN >@ ZH KDYH GHVFULEHG FROOHFWLQJ GDWD IURP WKRXVDQGV RI SHRSOH RQOLQH ZLWK D PXOWLSOD\HU JDPH DQG XVLQJ WKLVGDWDWROHDUQVWDWLVWLFDOPRGHOVRIODQJXDJHDQGEHKDYLRULQDQ HYHU\GD\VFHQDULRZLWKDQXQVXSHUYLVHGV\VWHP7KHVHPRGHOVRI VRFLDO QRUPV KDYH EHHQ GHPRQVWUDWHG WR KDYH WKH DELOLW\ WR HVWLPDWHWKHOLNHOLKRRGRIREVHUYHGLQWHUDFWLRQVZLWKDFFXUDF\WKDW FRUUHODWHVZHOOZLWKKXPDQMXGJPHQW7KLVSDSHUGHVFULEHVWDNLQJ WKH QH[W VWHS ± DXWRPDWLQJ FKDUDFWHUV ZLWK OHDUQHG EHKDYLRU DQG GLDORJXH 2XUVWXG\GRFXPHQWVSURPLVLQJUHVXOWVIURPWKHILUVWLWHUDWLRQRID V\VWHP WKDW JHQHUDWHV EHKDYLRU DQG GLDORJXH LQ UHDOWLPH IURP FROOHFWLYH PHPRULHV FDSWXUHG IURP RYHU  SHRSOH SOD\LQJ 7KH5HVWDXUDQW*DPH:HILUVWGHVFULEHWKHJDPHWKHFROOHFWLYH PHPRU\ V\VWHP DQG WKH SURSRVDOFULWLTXH GULYHQ DJHQW DUFKLWHFWXUH DQG WKHQ GHPRQVWUDWH TXDQWLWDWLYHO\ WKDW RXU V\VWHP

 Cite as: Automatic Learning and Generation of Social Behavior from Collective Human Gameplay, Jeff Orkin, Deb Roy, Proc. of 8th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2009), Decker, Sichman, Sierra and Castelfranchi (eds.), May, 10–15, 2009, Budapest, Hungary, pp. 385–392 Copyright © 2009, International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org), All rights reserved.

385

AAMAS 2009 • 8th International Conference on Autonomous Agents and Multiagent Systems • 10–15 May, 2009 • Budapest, Hungary

SUHVHUYHV WKH WH[WXUH RU PHDQLQJIXO ORFDO FRKHUHQFH RI KXPDQ VRFLDO LQWHUDFWLRQ ZKLOH IXWXUH ZRUN UHPDLQV WR FDSWXUH WKH KLJKHUOHYHOVWUXFWXUH (DFK JDPHSOD\ VHVVLRQ SURGXFHV D UDZ ORJ ILOH WKDW FDQ EH VXPPDUL]HGLQWRDPRUHKXPDQUHDGDEOHIRUP:HSURYLGHVRPH VDPSOH VXPPDUL]HG RXWSXW IURP DQ DFWXDO LQWHUDFWLRQ EHWZHHQ D KXPDQFXVWRPHUDQGDQDJHQWZDLWUHVVLQ)LJXUHZKLFKZHZLOO UHIHUEDFNWRDVZHGHVFULEHSDUWVRIWKHV\VWHP :$,75(66WDEOHIRURQH" &86720(5\HVMXVWPHWRQLJKW :$,75(66)ROORZPHSOHDVH &86720(56,7621FKDLU &KDLU  :$,75(666LWKHUH:RXOG\RXOLNHWRVHHDPHQX" &86720(5\HVSOHDVH :$,75(66RNRQHVHFRQGWKHQ :$,75(663,&.683G\Q 0HQX )520SRGLXP 3RGLXP  :$,75(66*,9(6G\Q 0HQX 72&86720(5 &86720(5WKDQNV :$,75(66WKHUH\RXJR &86720(5FDQ,VWDUWZLWKDEHHU" :$,75(66FHUWDLQO\FRPLQJULJKWXS :$,75(66FDQLKDYHDEHHUSOHDVH G\Q %HHU $33($5621EDU %DU  :$,75(663,&.683G\Q %HHU )520EDU %DU  :$,75(663876'2:1G\Q %HHU 21WDEOH 7DEOH  &86720(5WKDQNV

)LJXUH$KXPDQFXVWRPHUDQGDQDJHQWZDLWUHVVLQWHUDFW

 7+(5(67$85$17*$0( :H GHVLJQHG 7KH 5HVWDXUDQW *DPH DV D SODWIRUP IRU FROOHFWLQJ ULFKSK\VLFDODQGOLQJXLVWLFLQWHUDFWLRQDPRQJKXPDQV3OD\HUVRI 7KH5HVWDXUDQW*DPHDUHDQRQ\PRXVO\SDLUHGRQOLQHWRSOD\WKH UROHVRIDFXVWRPHUDQGZDLWUHVVLQD'YLUWXDOUHVWDXUDQW3OD\HUV FDQPRYHDURXQGWKHHQYLURQPHQWW\SHRSHQHQGHGFKDWWH[WDQG PDQLSXODWH REMHFWV ZLWK D SRLQWDQGFOLFN LQWHUIDFH (YHU\REMHFW SURYLGHV WKH VDPH LQWHUDFWLRQ RSWLRQV SLFN XS SXW GRZQ JLYH LQVSHFWVLWRQHDWDQGWRXFK2EMHFWVUHVSRQGWRWKHVHDFWLRQVLQ GLIIHUHQW ZD\V )RRG GLPLQLVKHV ELWH E\ ELWH ZKHQ HDWHQ ZKLOH HDWLQJ D FKDLU PDNHV D FUXQFK VRXQG EXW GRHV QRW FKDQJH WKH VKDSHRIWKHFKDLU3LFNLQJXSGULQNVIURPWKHEDUDOORZVDSOD\HU WR JLYHWKHGULQNWRWKHRWKHUSOD\HURUSXWWKHGULQNGRZQRQD VXUIDFH7U\LQJWRSLFNXSWKHEDULWVHOIUHVXOWVLQSOD\LQJDQDXGLR FOLSH[SUHVVLQJSK\VLFDOH[HUWLRQ 7RGDWHZHKDYHFROOHFWHGORJILOHVIURPFRPSOHWHGJDPHV SOD\HG E\  GLIIHUHQW SHRSOH $ JDPH WDNHV DERXW  PLQXWHVWRSOD\DQGLVFRQVLGHUHGFRPSOHWHLIWZRSOD\HUVMRLQHG DQGDWOHDVWRQHSOD\HUILOOHGRXWDVXUYH\LQGLFDWLQJDQLQWHQWLRQDO HQG WR WKH LQWHUDFWLRQ $Q DYHUDJH JDPH FRQVLVWV RI  SK\VLFDO DFWLRQV DQG  XWWHUDQFHV ZLWK DQ DYHUDJH OHQJWK RI IRXU ZRUGV HDFK3ULRUWRFRPSOHWLRQSOD\HULQWHUDFWLRQVYDU\JUHDWO\UDQJLQJ IURP JDPHV ZKHUH SOD\HUV GUDPDWL]H ZKDW RQH ZRXOG H[SHFW WR ZLWQHVVLQDUHVWDXUDQWWRJDPHVZKHUHSOD\HUVILOOWKHUHVWDXUDQW ZLWKFKHUU\SLHV:KLOHPDQ\SOD\HUVGRPLVEHKDYHRXUSUHYLRXV ZRUN >@ KDV GHPRQVWUDWHG WKDW ZKHQ LPPHUVHG LQ D IDPLOLDU HQYLURQPHQWHQRXJKSHRSOHGRHQJDJHLQEHKDYLRUWKDWDOORZVDQ

386

DXWRPDWLF V\VWHP WR OHDUQ YDOLG VWDWLVWLFDO PRGHOV RI W\SLFDO EHKDYLRUDQGODQJXDJH

 $*(17$5&+,7(&785(29(59,(: :HILUVWGHVFULEHWKHDJHQW¶VEHKDYLRUDWDKLJKOHYHODQGSURYLGH PRUHGHWDLOLQIROORZLQJVHFWLRQV7KHDJHQWLVGULYHQWRNHHSWKH LQWHUDFWLRQSURJUHVVLQJ$VWKHDJHQWREVHUYHVSOD\HUDFWLRQVDQG XWWHUDQFHV LW H[HFXWHV SODQV LQ UHVSRQVH ZKHUH SODQV FRQVLVW RI VHTXHQFHV RI SK\VLFDO DFWLRQV DQGRU GLDORJXH XWWHUDQFHV 5DWKHU WKDQ IRUPXODWLQJ SODQV DW UXQWLPH DJHQWV UHWULHYH SUHGHILQHG SODQV IURP FROOHFWLYH PHPRU\ JHQHUDWHG IURP JDPHSOD\ ORJV RI SUHYLRXVO\ UHFRUGHG KXPDQKXPDQ JDPHV 3ODQV GLUHFW WKH EHKDYLRU RI WKH DJHQW DQG SURYLGH H[SHFWDWLRQV DERXW WKH EHKDYLRU RI WKH RWKHU SOD\HU  :KHQ REVHUYDWLRQV GR QRW PDWFK H[SHFWDWLRQV WKH DJHQW UHHYDOXDWHV DYDLODEOH SODQV DQG VHOHFWV WKH SODQ WKDW PLQLPL]HV GHYLDWLRQ IURP WKH QRUP 7\SLFDOLW\ RI EHKDYLRU LV DVVHVVHG E\ H[SORLWLQJ SUHSURFHVVHG UHFXUUHQFH SDWWHUQV DFTXLUHG E\ DQDO\]LQJ WKH KXPDQ JDPHSOD\ GDWD 7KLV V\VWHP HQDEOHV WKH DJHQW WR SLYRW IURP RQH JDPHSOD\ ORJ WR DQRWKHU SURYLGLQJ FRQWH[WXDOO\ DSSURSULDWH UHVSRQVHV DV WKH VLWXDWLRQXQIROGV )LJXUH  GHSLFWV WKH IORZ RI LQIRUPDWLRQ WKURXJK WKH DJHQW DUFKLWHFWXUH7KHDJHQWREVHUYHVXWWHUDQFHVSK\VLFDODFWLRQVDQG VWDWH FKDQJHV WR WKH JDPH ZRUOG WKURXJK H[WHUQDO VHQVRUV 2EVHUYDWLRQV IURP VHQVRU\ LQSXW DUH VWRUHG LQ DQ LQWHUDFWLRQ KLVWRU\ RQ D EODFNERDUG VKDUHG EHWZHHQ WKH VHQVRU\ DFWLRQ VHOHFWLRQ DQG DFWXDWLRQ V\VWHPV  ,QWHUQDO UHIOHFWLYH VHQVRUV LQVSHFW WKH EODFNERDUG WR GHWHFW EURNHQ H[SHFWDWLRQV LQ WKH FXUUHQWO\DFWLYHSODQDQGPD\EURDGFDVWWKHQHHGWRVHOHFWDQHZ SODQ7KHDFWLRQVHOHFWLRQV\VWHPFRQGXFWVDSURFHVVRISURSRVDO DQG FULWLTXH WR VHOHFW D SODQ 3URSRVHG SODQV DUH UHWULHYHG IURP FROOHFWLYH PHPRU\ $ SURSRVDO FRQVLVWV RI DQ DFWLRQ RU GLDORJXH VHTXHQFH H[WUDFWHG IURP D KXPDQ JDPHSOD\ ORJ DQG DQ RIIVHW LQGH[IURPZKLFKWRVWDUWH[HFXWLQJWKHSODQ¶VDFWLRQV7KHLQGH[ PD\SRLQWWRDSK\VLFDODFWLRQRUXWWHUDQFHWREHH[HFXWHGE\WKH DJHQW RU WKH RWKHU SOD\HU ,I WKH DFWLRQ LV WR EH H[HFXWHG E\ WKH RWKHU SOD\HU LW LV WUHDWHG DV DQ H[SHFWDWLRQ WKDW DJHQW ZDLWV WR REVHUYH &ULWLFV VFUXWLQL]H SURSRVHG SODQV E\ FRPSDULQJ WKHP WR UHFXUUHQFHSDWWHUQVRIKXPDQEHKDYLRUDQGGLDORJXHOHDUQHGE\

*DPH:RUOG &ROOHFWLYH 0HPRU\

*DPHSOD\/RJV

$FWLRQ7UDFHV

([WHUQDO 6HQVRUV 5HIOHFWLYH 6HQVRUV $FWLRQ6HOHFWRU

%ODFNERDUG

,QWHUDFWLRQ +LVWRU\

3ODQ6WDWXV

,QWHUDFWLRQ*RDOV 'LDORJXH/LEUDULHV &ULWLFV

3ODQ

$FWXDWRU

*DPH:RUOG )LJXUH3URSRVDOFULWLTXHGULYHQDJHQWDUFKLWHFWXUH



Jeff Orkin, Deb Roy • Automatic Learning and Generation of Social Behavior from Collective Human Gameplay

UHIOHFWLQJ RQ JDPHSOD\ ORJV LQ FROOHFWLYH PHPRU\ 3ODQV PD\ EH UHMHFWHGIRUDQXPEHURIUHDVRQV±WKHQH[WDFWLRQLQWKHSURSRVHG SODQ LV XQOLNHO\RUSK\VLFDOO\LPSRVVLEOHRUWKHSUHYLRXVDFWLRQV LQ WKH SURSRVHG SODQ GR QRW PDWFK WKH UHFHQW KLVWRU\ IURP WKH FXUUHQWJDPH)LQDOO\WKHDFWXDWRUH[HFXWHVWKHQH[WDFWLRQLQWKH FXUUHQWSODQE\VHQGLQJDFRPPDQGWRWKHDJHQW¶VUHSUHVHQWDWLRQ LQWKHJDPHZRUOG$FRPPDQGPLJKWLQVWUXFWDQDJHQWWRVLWRQD FKDLU SLFN XS D VWHDN IURP WKH FRXQWHU RU XWWHU ³:KDW DUH \RXU VSHFLDOVWRQLJKW"´

IURP KXPDQKXPDQ LQWHUDFWLRQV 6LQJK DQG 0LQVN\ >@ KDYH SURSRVHG DQ DUFKLWHFWXUH ZKHUH FULWLFV GHWHFW ZKHQ DQ DJHQW¶V FXUUHQWDSSURDFKIDLOVWRVROYHDSUREOHPDQGVXJJHVWDOWHUQDWLYH ZD\VWRWKLQNDERXWLW2XUFULWLFVSURDFWLYHO\VFUXWLQL]HDYDLODEOH SODQVWRILQGRQHWKDWFRQIRUPVWRVRFLDOQRUPVDQGWKHEHOLHYHG VWDWH RI WKH ZRUOG %DUWR 6XWWRQ DQG $QGHUVRQ >@ KDYH DOVR SURSRVHGWKH$FWRU&ULWLFPHWKRGLQWKHGRPDLQRIUHLQIRUFHPHQW OHDUQLQJ

6HSDUDWLQJ WKH FULWLTXH SURFHVV IURP WKH SODQ UHWULHYDO V\VWHP DOORZV FULWLFV WR H[SORLW LQIRUPDWLRQ WKDW FROOHFWLYH PHPRU\ PD\ QRW EH SULY\ WR VXFK DV WKH LQWHUDFWLRQ KLVWRU\ DQG WKH DJHQW¶V EHOLHYHG VWDWH RI WKH ZRUOG ,W LV FRQFHLYDEOH WKDW FROOHFWLYH PHPRU\FRXOGH[LVWRQLWVRZQVHUYHUVKDUHGE\PDQ\DJHQWVRYHU WKH LQWHUQHW &ROOHFWLYH PHPRU\ PLJKW FRQWLQXDOO\ LQFRUSRUDWH QHZ KXPDQ JDPHSOD\ GDWD DQG KHWHURJHQHRXV DJHQWV FRXOG FKRRVHWRJHQHUDWHGLIIHUHQWDEVWUDFWLRQVIURPWKLVGDWD

$Q REYLRXV DSSURDFK WR DXWKRULQJ DJHQW EHKDYLRU ZRXOG EH WR DGRSWDQHVWDEOLVKHGIRUPDOLVPVXFKDV%',RU+71>@:KLOH WKHVH IRUPDOLVPV SURYLGH KLJKOHYHO VWUXFWXUH PDQ\ TXHVWLRQV UHPDLQUHJDUGLQJKRZWREXLOGPRGHOVRIEHKDYLRUWKDWDUHUREXVW LQ WKH IDFH RI XQSUHGLFWDEOH RSHQHQGHG KXPDQ LQWHUDFWLRQ DQG GLDORJXH  ,Q FRQWUDVW WKLV SDSHU H[SORUHV OHDUQLQJ WKH VXUIDFH OHYHO EHKDYLRU GLUHFWO\ IURP KXPDQKXPDQ LQWHUDFWLRQV 8OWLPDWHO\DUREXVWDJHQWUHTXLUHVPRGHOVRIERWKWKHKLJKOHYHO VWUXFWXUHDQGVXUIDFHOHYHOEHKDYLRU

 5(/$7(':25.

 &2//(&7,9(0(025@LWHUDWLQJRYHUHDFKWKUHHWRILYHZRUGVXEVWULQJZLWKLQHDFK XWWHUDQFHDQGLQVHUWLQJHDFKVXEVWULQJLQWRDVXIIL[WUHH>@2XU VXIIL[WUHHLVVLPSOLILHGE\UHVWULFWLQJHDFKEUDQFKDQGOHDIQRGHWR UHIHUHQFH RQO\ RQH ZRUG 8WWHUDQFHV DUH HQFORVHG LQ 67$57 DQG(1'PDUNHUVVRHYHQDRQHZRUGXWWHUDQFHEHFRPHVORQJ HQRXJK WR LQVHUW LQWR WKH WUHH :H EXLOG D VHSDUDWH WUHH IRU HDFK VRFLDO UROH  (DFK QRGH LQ WKH WUHH NHHSV WUDFN RI REVHUYHG IUHTXHQF\/HDIQRGHVREVHUYHGILYHWLPHVRUOHVVDUHSUXQHG $IWHU SUXQLQJ HDFK WUHH LV IODWWHQHG LQWR D SKUDVH OLEUDU\ FRQVLVWLQJ RI DQ LQGH[HG OLVW RI VDOLHQW SKUDVHV 7KH OLEUDULHV DUH JHQHUDWHG E\ DGGLQJ HDFK URRWWROHDI VHTXHQFH DV RQH SKUDVH SOXV HDFK URRWWREUDQFK VHTXHQFH IRU EUDQFK QRGHV ZKRVH IUHTXHQF\H[FHHGVWKHVXPRILWVFKLOGUHQ¶VIUHTXHQFLHVE\ILYH,Q RWKHUZRUGVLI³+HOOR´KDVWZRFKLOGUHQDQGZHREVHUYH³+HOOR´ DW OHDVW ILYH WLPHV PRUH RIWHQ WKDQ WKH VXP RI ³+HOOR WKHUH´ DQG ³+HOOR VLU´ ZH SUHVHUYH ³+HOOR´ DV LWV RZQ SKUDVH $V ZH DGG SKUDVHV WR WKH OLEUDU\ ZH FOXVWHU WKHP LI WKH\ VKDUH WKH VDPH QXPEHU RI ZRUGV DQG RQO\ GLIIHU E\ RQH QRQPDUNHU ZRUG )RU H[DPSOH ZH PLJKW FOXVWHU ³:HOFRPH WR WKH UHVWDXUDQW´ ZLWK ³:HOFRPH WR RXU UHVWDXUDQW´ DQG DVVLJQ LQGLFHV  DQG  UHVSHFWLYHO\ 1RWH WKDW WKLV FULWHULRQ GRHV DOORZ LQFRUUHFW FOXVWHULQJVXFKDV³:RXOG\RXOLNHDEHHU"´DQG³:RXOG\RXOLNH DWDEOH"´3UHVHUYLQJWKHVXELQGLFHVHQDEOHVWKHXWWHUDQFHUHWULHYDO V\VWHPWRILQGWKHEHVWPDWFKZKHQGLVFUHSDQFLHVH[LVW :H JHQHUDWH RQH GLDORJXH OLEUDU\ IRU HDFK SK\VLFDO DFWLRQ WKDW SUHFHGHVDGLDORJXHLQRQHRUPRUHJDPHV7KHOLEUDU\FRQWDLQVDOO GLDORJXH LQVWDQFHV REVHUYHG IROORZLQJ WKH DFWLRQ (DFK OLQH RI GLDORJXH LV WDJJHG ZLWK DQ DEVWUDFW VLJQDWXUH FRPSRVHG RI WKH XQRUGHUHG VHW RI SKUDVH OLEUDU\ LQGLFHV IRU SKUDVHV IRXQG ZLWKLQ WKH XWWHUDQFH 3KUDVHV UHIHUHQFHG LQ WKH VLJQDWXUH PD\ RYHUODS 7KH VLJQDWXUH IRU ³+L KRZ DUH \RX WRGD\"´ ZLOO LQFOXGH LQGLFHV IRUERWKKLBKRZBDUHB\RXDQGKRZBDUHB\RXBWRGD\

 6(1625@ %UDWPDQ0(,QWHQWLRQV3ODQVDQG3UDFWLFDO 5HDVRQ+DUYDUG8QLYHUVLW\3UHVV&DPEULGJH0$

 &21&/86,21 7KHUHDUHQXPHURXVRSSRUWXQLWLHVIRUYLUWXDORUURERWLFDJHQWVWKDW FDQDVVLVWHQWHUWDLQRUHGXFDWHGXVLQRXUKRPHVDQGZRUNSODFHV $OO RI WKHVH DJHQWV UHTXLUH KXPDQV WR DXWKRU WKHLU SK\VLFDO DQG FRPPXQLFDWLYH EHKDYLRUV DQG WRGD\ WKLV UHTXLUHV VSHFLDOL]HG VNLOOV ,Q WKLV SDSHU ZH KDYH GHPRQVWUDWHG WKDW LW LV SRVVLEOH WR DXWRPDWLFDOO\ H[WUDFW WKH WH[WXUH RI KXPDQ LQWHUDFWLRQ JLYHQ D FRUSXV RI WKRXVDQGV RI KXPDQ JDPHSOD\ ORJV 'HVSLWH WKH DSSDUHQW IUHHGRP JLYHQ WR SOD\HUV RI 7KH 5HVWDXUDQW *DPH ZH ILQG WKDW KXPDQV WHQG WR QDWXUDOO\ UHVWULFW WKHLU ODQJXDJH DQG EHKDYLRU ZKHQ SUHVHQWHG ZLWK D IDPLOLDU HQYLURQPHQW SURYLGLQJ YDOXDEOHGDWDWKDWFDQEHPLQHGWRGLUHFWDJHQWV7KHILUVWLWHUDWLRQ RIRXUDJHQWDXWRPDWLFDOO\OHDUQVWRLPLWDWHWKHWH[WXUHRIKXPDQ GLDORJXH DQG LQWHUDFWLRQ LQ D UHVWDXUDQW 7KLV ZRUN SURYLGHV D SURPLVLQJILUVWVWHSWRZDUGVUHDOL]LQJ&ROOHFWLYH$,GULYHQDJHQWV WKDW FDQ LQWHUDFW DQG FRQYHUVH ZLWK KXPDQV ZLWKRXW UHTXLULQJ SURJUDPPLQJ RU VSHFLDOLVWV WR KDQGFUDIW EHKDYLRU DQG GLDORJXH :KLOHZHDFNQRZOHGJHWKDWZHFDQQRWEXLOGUREXVWDJHQWVEDVHG SXUHO\ RQ PRGHOV RI VXUIDFHOHYHO EHKDYLRU WKLV WH[WXUH RI LQWHUDFWLRQ LV DQ LPSRUWDQW SLHFH WKDW LV GLIILFXOW WR FDSWXUH ZLWK KDQGFUDIWHGPRGHOVRIEHKDYLRU)XWXUHZRUNUHPDLQVWRSURYLGH DJHQWVZLWKUHSUHVHQWDWLRQVRILQWHQWLRQDOVWUXFWXUHDQGVHPDQWLFV RI ODQJXDJH $V D VWHS LQ WKLV GLUHFWLRQ ZH DUH FXUUHQWO\ GHYHORSLQJ D VSHHFK DFW FODVVLILHU WKDW ZLOO DOORZ XV WR PRGHO GLDORJXHDWJRDOGULYHQLQWHQWLRQDOOHYHO  



392

>@ %DUWR$*6XWWRQ56 $QGHUVRQ&: 1HXURQOLNHHOHPHQWVWKDWFDQVROYHGLIILFXOWOHDUQLQJFRQWURO SUREOHPV,(((7UDQVRQ6\VWHPV0DQDQG&\EHUQHWLFV ±

>@ %XUNH5,VOD''RZQLH0,YDQRY@ )LNHV5(DQG1LOVVRQ1-675,36$QHZ DSSURDFKWRWKHDSSOLFDWLRQRIWKHRUHPSURYLQJWRSUREOHP VROYLQJ$UWLILFLDO,QWHOOLJHQFH   >@ )OHLVFKPDQ0DQG5R\',QWHQWLRQDOFRQWH[WLQ VLWXDWHGODQJXDJHOHDUQLQJ1LQWK&RQIHUHQFHRQ &RPSXWDWLRQDO1DWXUDO/DQJXDJH/HDUQLQJ >@ *RULQ$5LFFDUGL*:ULJKW-+RZPD\,KHOS \RX"6SHHFK&RPPXQLFDWLRQ9ROXPH(OVHYLHU6FLHQFH >@ *RUQLDN3DQG5R\'6LWXDWHGODQJXDJH XQGHUVWDQGLQJDVILOWHULQJSHUFHLYHGDIIRUGDQFHV&RJQLWLYH 6FLHQFH   >@ *XVILHOG'$OJRULWKPVRQ6WULQJV7UHHVDQG 6HTXHQFHV&RPSXWHU6FLHQFHDQG&RPSXWDWLRQDO%LRORJ\ &KDSWHU/LQHDUWLPHFRQVWUXFWLRQRIVXIIL[WUHHV± &DPEULGJH8QLYHUVLW\3UHVV >@ 1DX'&DR@2UNLQ-DQG5R\'7KH5HVWDXUDQW*DPH/HDUQLQJ VRFLDOEHKDYLRUDQGODQJXDJHIURPWKRXVDQGVRISOD\HUV RQOLQH-RXUQDORI*DPH'HYHORSPHQW   >@2UNLQ-$JHQWDUFKLWHFWXUHFRQVLGHUDWLRQVIRUUHDO WLPHSODQQLQJLQJDPHV3URFHHGLQJVRI$UWLILFLDO ,QWHOOLJHQFH ,QWHUDFWLYH'LJLWDO(QWHUWDLQPHQW$$$, 3UHVV >@3DSLQHQL.5RXNRV6:DUG7DQG=KX:- %/(8$PHWKRGIRUDXWRPDWLFHYDOXDWLRQRIPDFKLQH WUDQVODWLRQ$&/WK$QQXDOPHHWLQJRIWKH $VVRFLDWLRQIRU&RPSXWDWLRQDO/LQJXLVWLFV >@5DYLFKDQGUDQ'DQG+RY\(/HDUQLQJVXUIDFHWH[W SDWWHUQVIRUDTXHVWLRQDQVZHULQJV\VWHP,Q3URFHHGLQJVRI WKHWK$&/&RQIHUHQFH >@6LQJK3DQG0LQVN\0$QDUFKLWHFWXUHIRU FRPELQLQJZD\VWRWKLQN3URFHHGLQJVRIWKH,QWHUQDWLRQDO &RQIHUHQFHRQ.QRZOHGJH,QWHQVLYH0XOWL$JHQW6\VWHPV >@YRQ$KQ/DQG'DEELVK//DEHOLQJLPDJHVZLWKD FRPSXWHUJDPH3URFHHGLQJVRIWKH6,*&+,FRQIHUHQFHRQ +XPDQIDFWRUVLQFRPSXWLQJV\VWHPV