Evolutionary and deep reinforcement learning algorithms for optimizing the lifetime of wireless sensor networks

)"/0* 6/*7&34*5: 0' 4$*&/$& "/% 5&$)/0-0(: "45&3 5)&4*4 &WPMVUJPOBSZ BOE %FFQ 3FJOGPSDFNFOU -FBSOJOH "MHPSJUINT GPS 0QUJNJ[JOH UIF -JGFUJNF PG 8JSFMFTT 4FOTPS /FUXPSLT #6* )0/( /(0$ QJRFEKP#VLVKXVWHGX BKPS  %BUB 4DJFODF &MJUFDI 7KHVLV DGYLVRU %FQBSUNFOU *OTUJUVUF    %S /HVZFO 1IJ -F %FQBSUNFOU PG $PNQVUFS 4DJFODF 4DIPPM PG *OGPSNBUJPO BOE $PNNVOJDBUJPO 5FDIOPMPHZ )BOPJ  )"/0* 6/*7&34*5: 0' 4$*&/$& "/% 5&$)/0-0(: "45&3 5)&4*4 &WPMVUJPOBSZ BOE %FFQ 3FJOGPSDFNFOU -FBSOJOH "MHPSJUINT GPS 0QUJNJ[JOH UIF -JGFUJNF PG 8JSFMFTT 4FOTPS /FUXPSLT #6* )0/( /(0$ QJRFEKP#VLVKXVWHGX BKPS  %BUB 4DJFODF &MJUFDI 7KHVLV DGYLVRU  %S /HVZFO 1IJ -F %FQBSUNFOU *OTUJUVUF   %FQBSUNFOU PG $PNQVUFS 4DJFODF 4DIPPM PG *OGPSNBUJPO BOE $PNNVOJDBUJPO 5FDIOPMPHZ 4JHOBUVSF PG BEWJTPS )BOPJ  &Ӝ1*+Ñ$;­+Ӝ,&+Ӫ1*+Ƭ$9,ӊ71$0 ĈӝFOұS– 7ӵGR– +ҥQKSK~F %Ҧ1;È&1+Ұ1&+ӌ1+6Ӱ$ /8Ұ19Ă17+Ҥ&6Ƭ +ӑYjWrQWiFJLҧOXұQYăQ%L+ӗQJ1JӑF ĈӅWjLOXұQYăQCác giҧi thuұt tiӃn hoá hӑFWăQJFѭӡQJÿӇ tӕLѭXWKӡi gian sӕng cӫa mҥng cҧm biӃn không dây Chuyên ngành: KRDKӑFGӳOLӋX(Elitech) 0mVӕ69: 20212155M 7iFJLҧ1JѭӡLKѭӟQJGүQNKRDKӑFYj+ӝLÿӗQJFKҩPOXұQYăQ[iFQKұQWiFJLҧ ÿmVӱDFKӳDEәVXQJOXұQYăQWKHRELrQEҧQKӑS+ӝLÿӗQJQJj\ 28/04/2023 YӟLFiF QӝLGXQJVDX - +LӋXFKӍQKWrQFKѭѫQJ YjFKѭѫQJ ÿӇOjPU}KѫQQӝLGXQJWUuQKEj\ - 7KrPFiFWKҧROXұQӣFKѭѫQJQKҵPOjPU}KѫQFiFVӵNKiFELӋWWURQJÿyQJ JySӣFKѭѫQJVRYӟLÿӗiQWӕWQJKLӋSNӻVѭFӫDFQJWiFJLҧ - 7KrPFiFWKҧROXұQӣFKѭѫQJYjFKѭѫQJÿӇOjPU}ÿӝQJOӵFYjVӵNKiFELӋW FӫDWKXұWWRiQÿӅ[XҩWVRYӟLFiFWKXұWWRiQWUѭӟFÿy - 7KrPFiFWKҧROXұQYӅKҥQFKӃFӫDFiFJLҧÿӏQKVRYӟLP{LWUѭӡQJWKӵFWӃWURQJ FiFEjLWRiQӣFKѭѫQJYjFKѭѫQJ - 5jVRiWKLӋXFKӍQKFiFOӛLVRҥQWKҧR 1Jj\WKiQJQăP2023 *LiRYLrQKѭӟQJGүQ 7iFJLҧOXұQYăQ &+Ӫ7ӎ&++Ӝ,ĈӖ1* 6Ĉ+47%0 %DQKjQKOҫQ1 ngày 11/11/2014 *5$'85$7,21 7+(6,6 $66,*10(17  6WXGHQW¶V LQIRUPDWLRQ  1DPH  %XL +RQJ 1JRF 3KRQH     (PDLO QJRFEKP#VLVKXVWHGX &ODVV  'DWD 6FLHQFH $IILOLDWLRQ  +DQRL 8QLYHUVLW\ RI 6FLHQFH DQG 7HFKQRORJ\ 'XUDWLRQ      7KHVLV WLWOH  (YROXWLRQDU\ DQG 'HHS 5HLQIRUFHPHQW /HDUQLQJ $OJRULWKPV IRU 2SWL PL]LQJ WKH /LIHWLPH RI :LUHOHVV 6HQVRU 1HWZRUNV  7KHVLV VWDWHPHQW  7KLV WKHVLV SURSRVHV HYROXWLRQDU\ DQG GHHS UHLQIRUFHPHQW OHDUQLQJ DOJRULWKPV WR WDFNOH WZR HPHUJLQJ WHFKQLTXHV LQ SURORQJLQJ WKH OLIHWLPH RI ZLUHOHVV VHQVRU QHW ZRUNV  'HFODUDWLRQV'LVFORVXUHV  , ± %XL +RQJ 1JRF ± KHUHE\ ZDUUDQWV WKDW WKH ZRUN DQG SUHVHQWDWLRQ LQ WKLV WKHVLV DUH SHUIRUPHG E\ P\VHOI XQGHU WKH VXSHUYLVLRQ RI 'U 1JX\HQ 3KL /H $OO UHVXOWV SUHVHQWHG LQ WKLV WKHVLV DUH WUXWKIXO DQG DUH QRW FRSLHG IURP DQ\ RWKHU ZRUNV $OO UHIHUHQFHV LQ WKLV WKHVLV  LQFOXGLQJ LPDJHV WDEOHV ILJXUHV DQG TXRWHV  DUH FOHDUO\ DQG IXOO\ GRFXPHQWHG LQ WKH ELEOLRJUDSK\ , ZLOO WDNH IXOO UHVSRQVLELOLW\ IRU HYHQ RQH FRS\ WKDW YLRODWHV VFKRRO UHJXODWLRQV +DQRL GDWH PRQWK $XWKRU \HDU  %XL +RQJ 1JRF  $WWHVWDWLRQ RI WKHVLV DGYLVRU , FHUWLI\ WKDW , KDYH UHDG WKLV WKHVLV DQG WKDW LQ P\ RSLQLRQ LW LV IXOO\ DGHTXDWH LQ VFRSH DQG TXDOLW\ DV D WKHVLV IRU WKH GHJUHH RI 0DVWHU RI 6FLHQFH +DQRL GDWH PRQWK \HDU  7KHVLV $GYLVRU 'U 1JX\HQ 3KL /H "DLOPXMFEHNFOUT , ZRXOG OLNH WR H[SUHVV P\ JUDWLWXGH WR DOO WKRVH ZKR KDYH PRWLYDWHG DQG DLGHG PH LQ DFKLHYLQJ WKLV VLJQLILFDQW PLOHVWRQH LQ P\ OLIH 0\ KHDUWIHOW DSSUHFLDWLRQ JRHV RXW WR P\ WKHVLV DGYLVRUV 'U 1JX\HQ 3KL /H DQG 3URI 'R 3KDQ 7KXDQ ZKRVH HQFRXUDJHPHQW DQG JXLGDQFH ZHUH LQYDOXDEOH LQ VKDSLQJ WKH UHVHDUFK TXHVWLRQV DQG PHWKRGRORJ\ :LWKRXW WKHLU VXSHUYLVLRQ DQG LQVLJKWIXO VXJJHVWLRQV FRPSOHWLQJ WKLV WKHVLV ZRXOG KDYH EHHQ DQ LQVXUPRXQWDEOH FKDOOHQJH , RZH D GHEW RI JUDWLWXGH WR P\ DGYLVRU DW 9LQ$, 'U 1JX\HQ 9LHW $QK IRU KLV XQ ZDYHULQJ VXSSRUW WKURXJKRXW P\ WZR \HDUV DW 9LQ$, +LV H[SHUWLVH DQG JXLGDQFH KDYH HQDEOHG PH WR QRW RQO\ FRPSOHWH WKLV WKHVLV EXW DOVR JDLQ WKH NQRZOHGJH DQG VNLOOV QHFHV VDU\ IRU P\ IXWXUH FDUHHU %H\RQG DFDGHPLF UHVHDUFK KH ZDV DOZD\V DYDLODEOH WR SURYLGH DGYLFH DQG JXLGDQFH RQ YDULRXV DVSHFWV RI P\ SHUVRQDO DQG SURIHVVLRQDO GHYHORSPHQW +LV VXSSRUW KDV EHHQ D VRXUFH RI LQVSLUDWLRQ DQG PRWLYDWLRQ IRU PH WKURXJKRXW P\ MRXUQH\ $GGLWLRQDOO\ 7KH LQYDOXDEOH IHHGEDFN DQG VXJJHVWLRQV SURYLGHG E\ 3URI +X\QK 7KL 7KDQK %LQK DQG 'U 1JX\HQ 7KL 7DP ZHUH HVVHQWLDO WR WKH FRPSOHWLRQ RI WKLV WKHVLV 7KHLU H[WHQVLYH H[SHUWLVH LQ WKH ILHOG ZDV FUXFLDO WR WKH GHYHORSPHQW RI YDULRXV DVSHFWV RI WKLV ZRUN DQG , DP GHHSO\ JUDWHIXO IRU WKHLU VXSSRUW DQG JXLGDQFH WKURXJKRXW WKH SURFHVV :LWKRXW WKHLU FRQWULEXWLRQV WKLV WKHVLV ZRXOG QRW KDYH EHHQ FRPSOHWHG , DOVR ZLVK WR DFNQRZOHGJH P\ IULHQGV DW +867 DQG 9LQ$, ZKRVH XQZDYHULQJ VXSSRUW DQG FRPSDQLRQVKLS KDYH EHHQ D VRXUFH RI VWUHQJWK DQG PRWLYDWLRQ WKURXJKRXW P\ WLPH DW WKH XQLYHUVLW\ DQG FRPSDQ\ 7KH PHPRULHV RI SOD\LQJ JDPHV ZDWFKLQJ PRYLHV DQG HQMR\LQJ IRRWEDOO PDWFKHV DUH SULFHOHVV DQG KDYH NHSW PH JRLQJ /DVWO\ , GHGLFDWH WKLV WKHVLV WR P\ IDPLO\ P\ SDUHQWV ZKR KDYH DOZD\V HQFRXUDJHG PH WR SXUVXH P\ GUHDPV P\ JLUOIULHQG ZKR KDV VWRRG E\ PH GXULQJ P\ PRVW GLIILFXOW PRPHQWV OLVWHQLQJ DQG HPSDWKL]LQJ ZLWK P\ JULHYDQFHV DERXW WKH ZRUOG DQG P\ VLVWHU ZKR PD\ VRPHWLPHV EH D QXLVDQFH EXW DOZD\V DGG FRORU WR P\ OLIH 7RJHWKHU WKH\ KDYH VKDSHG WKH SHUVRQ , DP WRGD\ L (YROXWLRQDU\ DQG 'HHS 5HLQIRUFHPHQW /HDUQLQJ $OJRULWKPV IRU 2SWLPL]LQJ WKH /LIHWLPH RI :LUHOHVV 6HQVRU 1HWZRUNV $EVWUDFW ,Q UHFHQW \HDUV ZLUHOHVV VHQVRU QHWZRUNV :61V KDYH EHFRPH DQ HVVHQWLDO SDUW RI PDQ\ FLYLOLDQ DSSOLFDWLRQV VXFK DV VPDUW DJULFXOWXUH KHDOWK PRQLWRULQJ DQG VPDUW FLWLHV +RZHYHU WKH OLPLWHG HQHUJ\ FDSDFLW\ RI WKH VHQVRUV SRVHV D VLJQLILFDQW FKDOOHQJH WR HQ VXULQJ FRQWLQXRXV VXUYHLOODQFH ,Q WKLV WKHVLV ZH VWXG\ WZR HPHUJLQJ WHFKQLTXHV WR SUR ORQJ WKH QHWZRUN¶V OLIHWLPH HQHUJ\HIILFLHQW URXWLQJ YLD UHOD\ QRGH SODFHPHQW DQG URXWLQJ VWUDWHJLHV IRU WKH PRELOH FKDUJHU LQ ZLUHOHVV UHFKDUJHDEOH VHQVRU QHWZRUNV :561V  7KH ILUVW SUREOHP LQYROYHV RSWLPL]LQJ WKH URXWLQJ SURWRFRO E\ GHSOR\LQJ QRQVHQVLQJ UHOD\ QRGHV 51V  5HFHQW UHVHDUFK HLWKHU IRFXVHG RQ ILQGLQJ WKH PLQLPXP QXPEHU RI 51V UHTXLUHG WR UHGXFH GHSOR\PHQW FRVWV RU GHYHORSLQJ HIILFLHQW URXWLQJ VFKHPHV WR UH GXFH HQHUJ\ XVH +RZHYHU VWULNLQJ D EDODQFH EHWZHHQ WKHVH FULWHULD UHPDLQV D VLJQLILFDQW FKDOOHQJH 7R DGGUHVV WKLV LVVXH ZH SURSRVH D PXOWLREMHFWLYH DSSURDFK WR FRQVWUXFWLQJ DQ HIILFLHQW FRPPXQLFDWLRQ VWUXFWXUH ZLWK WKH OHDVW SRVVLEOH QXPEHU RI 51V WKHUHE\ SUR ORQJLQJ WKH QHWZRUN¶V OLIHWLPH ZKLOH HQVXULQJ LWV FRQQHFWLYLW\ DQG UHOLDELOLW\ :H FRQGXFW H[WHQVLYH H[SHULPHQWV WR GHPRQVWUDWH WKH HIIHFWLYHQHVV RI RXU PHWKRG DQG VKRZ WKDW LW SURYLGHV D EHWWHU WUDGHRII FRPSDUHG WR H[LVWLQJ DOJRULWKPV ,Q WKH VHFRQG SUREOHP ZH IRFXV RQ DGGUHVVLQJ WKH FKDOOHQJHV IDFHG LQ :561V ZKHUH D PRELOH FKDUJHU FDQ EH HPSOR\HG WR PRYH DURXQG DQG FKDUJH WKH VHQVRUV ([LVWLQJ DS SURDFKHV VWUXJJOH WR GHVLJQ DQ RSWLPDO FKDUJLQJ SDWK IRU WKH PRELOH FKDUJHU ZKLOH DFFRXQW LQJ IRU WKH XQFHUWDLQWLHV DULVLQJ LQ WKH QHWZRUN ZKLFK FRXOG FRPH IURP QRGH IDLOXUHV RU GHSOR\PHQWV 7R RYHUFRPH WKLV FKDOOHQJH ZH SURSRVH D QRYHO FKDUJLQJ VFKHPH WKDW XVHV D GHHS UHLQIRUFHPHQW OHDUQLQJ '5/ DSSURDFK WR JXLGH WKH PRELOH FKDUJHU DGDSWLYHO\ 2XU DSSURDFK HQDEOHV WKH PRELOH FKDUJHU WR DGDSW WR VSRQWDQHRXV FKDQJHV LQ WKH QHWZRUN WRSRO RJ\ 7KH H[SHULPHQWV VKRZ WKH VXSHULRULW\ RI RXU PRGHO FRPSDUHG WR H[LVWLQJ RQGHPDQG PHWKRGV LQ SURORQJLQJ WKH QHWZRUN OLIHWLPH 2XU SURSRVHG VROXWLRQV IRU WKH WZR SUREOHPV RI UHOD\ QRGH SODFHPHQW DQG PRELOH FKDUJHU URXWLQJ FDQ VLJQLILFDQWO\ SURORQJ WKH QHWZRUN¶V OLIHVSDQ DQG UHGXFH PDLQWHQDQFH FRVWV 7KH SRWHQWLDO IRU FRPELQLQJ WKHVH WZR WHFKQLTXHV LQ :561V WR IXUWKHU HQKDQFH WKH QHWZRUN¶V VXVWDLQDELOLW\ DQG UHOLDELOLW\ LV DQ LQWHUHVWLQJ IXWXUH UHVHDUFK GLUHFWLRQ $GRSWLQJ WKHVH VROXWLRQV HVSHFLDOO\ QHZ DGYDQFHPHQWV LQ GHHS UHLQIRUFHPHQW OHDUQLQJ FDQ IDFLOLWDWH WKH GHYHORSPHQW RI PRUH HIILFLHQW DQG HIIHFWLYH :61V HQDEOLQJ XV WR EHWWHU PRQLWRU DQG PDQDJH YDULRXV V\VWHPV DQG SURFHVVHV LQ RXU GDLO\ OLYHV LL DSSURDFK WR JXLGH WKH PRELOH FKDUJHU DGDS WLYHO\ 2XU DSSURDFK HQDEOHV WKH PRELOH FKDUJHU WR DGDSW WR VSRQWDQHRXV FKDQJHV LQ WKH QHWZRUN WRSRORJ\  ĉFTJT DPOUSJCVUJPOT 7KH PDLQ FRQWULEXWLRQV RI WKLV WKHVLV FDQ EH VXPPDUL]HG DV IROORZV ‡ ,Q WKLV VWXG\ ZH H[DPLQH FRPPRQ DSSURDFKHV IRU SURORQJLQJ WKH QHWZRUN OLIHWLPH LQ ZLUHOHVV VHQVRU QHWZRUNV ZKLFK FDQ EH FODVVLILHG LQWR WZR PDLQ JURXSV VHQVRU IXQFWLRQLQJ RSWLPL]DWLRQ DQG HQHUJ\ UHSOHQLVKPHQW :H LQYHVWLJDWH RQH HPHUJLQJ LVVXH IRU HDFK JURXS ZKLFK FDQ KHOS LQ H[WHQGLQJ WKH QHWZRUN OLIHWLPH IXUWKHU ‡ ,Q &KDSWHU  ZH LQYHVWLJDWH HQHUJ\HIILFLHQW URXWLQJ WHFKQLTXHV E\ FRQVLGHULQJ WKH UHOD\ QRGH SODFHPHQW DV D PXOWLREMHFWLYH SUREOHP :H LQWURGXFH D QRYHO PXOWL REMHFWLYH HYROXWLRQDU\ DOJRULWKP WKDW H[SORLWV SUREOHPVSHFLILF IHDWXUHV WR ILQG D 3DUHWRIURQW WKDW EDODQFHV WKH WUDGHRII EHWZHHQ WKH QXPEHU RI UHOD\ QRGHV DQG WKH QHWZRUN¶V HQHUJ\ FRQVXPSWLRQ :H FRQGXFW H[WHQVLYH H[SHULPHQWV WR GHPRQVWUDWH WKH HIIHFWLYHQHVV RI RXU PHWKRG DQG VKRZ WKDW LW SURYLGHV D EHWWHU WUDGHRII FRPSDUHG WR H[LVWLQJ DOJRULWKPV 7KH SDSHU VXPPDUL]LQJ WKH UHVXOWV LV XQGHU UHYLHZ LQ WKH 6RIW &RPSXWLQJ MRXUQDO %XL HW DO   ‡ ,Q &KDSWHU  ZH FRQVLGHU WKH RQGHPDQG FKDUJLQJ SUREOHP LQ :561 VHWWLQJV :H SURSRVH DQ DGDSWLYH FKDUJLQJ VFKHPH IRU WKH 0& XVLQJ GHHS UHLQIRUFHPHQW OHDUQLQJ WR FKRRVH WKH QH[W FKDUJLQJ GHVWLQDWLRQ 2XU SURSRVHG IUDPHZRUN LV IOH[LEOH DV LW FDQ RSHUDWH LQ D G\QDPLF VHQVRU QHWZRUN ZKHUH WKH QXPEHU RI VHQVRUV PLJKW FKDQJH GXH WR QRGH IDLOXUHV RU GHSOR\PHQWV 7KH H[SHULPHQWV VKRZ WKH VXSHULRULW\ RI RXU PRGHO FRPSDUHG WR H[LVWLQJ RQGHPDQG PHWKRGV LQ SURORQJLQJ WKH QHWZRUN OLIHWLPH 7KH UHVXOWV ZHUH SXEOLVKHG DW WKH ,((( 0$66  %XL HW DO    ĉFTJT PVUMJOF 7KH WKHVLV LV VWUXFWXUHG DV IROORZV ,Q &KDSWHU  ZH SURYLGH DQ RYHUYLHZ RI WKH HYROXWLRQDU\ DQG GHHS UHLQIRUFHPHQW OHDUQLQJ DOJRULWKPV XWLOL]HG LQ WKLV VWXG\ :H LQWURGXFH WKH IXQGDPHQWDO FRQFHSWV DQG SULQFLSOHV RI WKHVH DOJRULWKPV WR SURYLGH UHDGHUV ZLWK WKH QHFHVVDU\ EDFNJURXQG NQRZO HGJH IRU VXEVHTXHQW FKDSWHUV  ,Q &KDSWHU  ZH SUHVHQW D FRPSUHKHQVLYH VXUYH\ RI WKH QHWZRUN OLIHWLPH SUREOHP LQ :61V 2XU VXUYH\ FRYHUV FXUUHQW VWDWHRIWKHDUW ZRUNV LQ VHQVRU IXQFWLRQLQJ RSWL PL]DWLRQ DQG HQHUJ\ UHSOHQLVKPHQW DSSURDFKHV :H DOVR SURYLGH DQ LQGHSWK DQDO\VLV RI HQHUJ\HIILFLHQW URXWLQJ DSSURDFKHV DQG DGDSWLYH FKDUJLQJ VFKHPHV LQ :561V 7KLV DQDO \VLV ZLOO SRVLWLRQ RXU ZRUN EHWWHU LQ WKH OLWHUDWXUH ,Q &KDSWHU  ZH GHOYH LQWR WKH UHOD\ QRGH SODFHPHQW SUREOHP DQG SUHVHQW RXU PXOWL REMHFWLYH IUDPHZRUN IRU DGGUHVVLQJ WKLV SUREOHP :H GHVFULEH WKH SUREOHP VWDWHPHQW DQG WKH GHVLJQ RI RXU DOJRULWKP ZKLFK WDNHV LQWR DFFRXQW SUREOHPVSHFLILF SURSHUWLHV WR ILQG D 3DUHWRIURQW WKDW EDODQFHV WKH QXPEHU RI UHOD\ QRGHV DQG WKH QHWZRUN¶V HQHUJ\ FRQVXPS WLRQ :H DOVR FRQGXFW H[SHULPHQWV WR GHPRQVWUDWH WKH HIIHFWLYHQHVV RI RXU DSSURDFK DQG FRPSDUH LW ZLWK H[LVWLQJ DOJRULWKPV ,Q &KDSWHU  ZH SUHVHQW RXU DGDSWLYH GHHS UHLQIRUFHPHQW OHDUQLQJ IUDPHZRUN IRU VFKHGXOLQJ FKDUJLQJ WUDMHFWRULHV IRU PRELOH FKDUJHUV LQ :561 VHWWLQJV :H GHVFULEH WKH GHVLJQ RI RXU DSSURDFK ZKLFK HQDEOHV WKH PRELOH FKDUJHU WR FKRRVH WKH QH[W FKDUJLQJ GHVWLQDWLRQ DGDSWLYHO\ EDVHG RQ WKH FXUUHQW HQHUJ\ OHYHOV RI WKH VHQVRUV DQG WKH QHWZRUN¶V WRSRORJ\ :H GHPRQVWUDWH WKH HIIHFWLYHQHVV RI RXU PRGHO WKURXJK H[WHQVLYH H[SHULPHQWV DQG FRPSDUH LW ZLWK H[LVWLQJ RQGHPDQG FKDUJLQJ PHWKRGV )LQDOO\ LQ &KDSWHU  ZH FRQFOXGH WKH WKHVLV E\ VXPPDUL]LQJ RXU FRQWULEXWLRQV DQG KLJKOLJKWLQJ WKH NH\ ILQGLQJV RI RXU VWXG\ DQG WKHQ SURYLGLQJ UHFRPPHQGDWLRQV IRU IXWXUH ZRUNV  $IBQUFS  #BDLHSPVOE ,Q WKLV FKDSWHU ZH SUHVHQW DQ RYHUYLHZ RI WKH HYROXWLRQDU\ DQG GHHS UHLQIRUFHPHQW OHDUQ LQJ DOJRULWKPV XVHG LQ WKH VWXG\ 7KH SXUSRVH RI WKLV FKDSWHU LV WR LQWURGXFH UHDGHUV WR WKH EDVLF FRQFHSWV DQG SULQFLSOHV RI WKHVH DOJRULWKPV ZKLFK ZLOO EH QHFHVVDU\ IRU XQGHU VWDQGLQJ WKH VXEVHTXHQW FKDSWHUV :H LQWURGXFH PXOWLREMHFWLYH RSWLPL]DWLRQ 022 SURE OHPV DQG GHVFULEH KRZ HYROXWLRQDU\ DOJRULWKPV VLPXODWH WKH SURFHVV RI QDWXUDO VHOHFWLRQ WR HYROYH RSWLPDO VROXWLRQV WR 022 SUREOHPV LQ 6HFWLRQ  :H DOVR H[SODLQ KRZ GHHS UHLQIRUFHPHQW OHDUQLQJ DOJRULWKPV FRPELQH QHXUDO QHWZRUNV DQG UHLQIRUFHPHQW OHDUQLQJ WR HQDEOH DJHQWV WR OHDUQ IURP WKHLU H[SHULHQFHV DQG LPSURYH WKHLU GHFLVLRQPDNLQJ DELOLWLHV RYHU WLPH LQ 6HFWLRQ   VMUJPCKFDUJWF &WPMVUJPOBSZ "MHPSJUINT  VMUJPCKFDUJWF PQUJNJ[BUJPO QSPCMFNT 0XOWLREMHFWLYH RSWLPL]DWLRQ 022 LV D EUDQFK RI RSWLPL]DWLRQ WKDW GHDOV ZLWK SUREOHPV LQYROYLQJ PXOWLSOH FRQIOLFWLQJ REMHFWLYHV ,Q 022 WKH JRDO LV WR ILQG D VHW RI VROXWLRQV WKDW VLPXOWDQHRXVO\ RSWLPL]H PXOWLSOH REMHFWLYHV 7KHVH REMHFWLYHV RIWHQ FRQIOLFW ZLWK HDFK RWKHU OHDGLQJ WR QR VLQJOH VROXWLRQ EHLQJ RSWLPDO IRU DOO REMHFWLYHV 0DWKHPDWLFDOO\ D PXOWLREMHFWLYH RSWLPL]DWLRQ SUREOHP FDQ EH IRUPXODWHG DV (f1 (x), f2 (x), , fm (x)) x∈X  ZKHUH fi : X → R LV WKH iWK REMHFWLYH IXQFWLRQ $V WKHUH DUH FRQIOLFWLQJ FULWHULD ZH ILUVW QHHG D GHILQLWLRQ RI VROXWLRQ GRPLQDWLRQ WR FRPSDUH EHWZHHQ VROXWLRQV 'HILQLWLRQ  6ROXWLRQ GRPLQDWLRQ  $ VROXWLRQ x1 LV VDLG WR GRPLQDWH DQRWKHU VROXWLRQ x2  GHQRWHG x1  x2  LI x1 LV QR ZRUVH WKDQ x2 LQ DOO REMHFWLYHV DQG LV VWULFWO\ EHWWHU LQ DW OHDVW RQH REMHFWLYH $ VROXWLRQ x1 LV VDLG WR EH QRQGRPLQDWHG LI WKHUH LV QR RWKHU VROXWLRQ LQ WKH SRSXODWLRQ WKDW GRPLQDWHV x1  7KH 3DUHWR IURQW KHOS UHSUHVHQWV WKH VHW RI QRQGRPLQDWHG VROXWLRQV $ VROXWLRQ LV 3DUHWR RSWLPDO LI WKHUH LV QR RWKHU VROXWLRQ WKDW LV EHWWHU LQ DOO REMHFWLYHV 7KH 3DUHWR IURQW FDQ EH PDWKHPDWLFDOO\ IRUPXODWHG DV IROORZV /HW x ∈ X GHQRWH D VROXWLRQ YHFWRU ZKHUH X LV WKH IHDVLEOH UHJLRQ /HW f (x) = [f1 (x), f2 (x), , fm (x)] GHQRWH WKH  )LJXUH  3DUHWR GRPLQDQFH 6RXUFH 9HUPD HW DO   YHFWRU RI m REMHFWLYH IXQFWLRQV 7KHQ WKH 3DUHWR IURQW FDQ EH GHILQHG DV P = {x ∈ X |x ∈ X VXFK WKDW f (x ) ≺ f (x)}, ZKHUH f (x) ≺ f (x ) GHQRWHV WKDW x GRPLQDWHV x PHDQLQJ WKDW x LV QR ZRUVH WKDQ x LQ DOO REMHFWLYHV DQG VWULFWO\ EHWWHU WKDQ x LQ DW OHDVW RQH REMHFWLYH )LJXUH  VKRZV DQ H[DPSOH RI WKH 3DUHWR IURQW 7KH 3DUHWR IURQW LV D XVHIXO WRRO IRU GHFLVLRQPDNLQJ LQ 022 EHFDXVH LW SURYLGHV D VHW RI WUDGHRII VROXWLRQV WKDW GHFLVLRQPDNHUV FDQ FKRRVH IURP EDVHG RQ WKHLU SUHIHUHQFHV  /POEPNJOBUFE TPSUJOH HFOFUJD BMHPSJUIN 0XOWLREMHFWLYH HYROXWLRQDU\ DOJRULWKPV 02($V DUH D FODVV RI RSWLPL]DWLRQ DOJRULWKPV WKDW DUH GHVLJQHG WR WDFNOH 022 SUREOHPV 02($V DUH LQVSLUHG E\ WKH SURFHVV RI QDWXUDO VHOHFWLRQ ZKHUH LQGLYLGXDOV ZLWK EHWWHU ILWQHVV DUH PRUH OLNHO\ WR VXUYLYH DQG UHSURGXFH ,Q 02($V FDQGLGDWH VROXWLRQV DUH UHSUHVHQWHG DV LQGLYLGXDOV LQ D SRSXODWLRQ DQG WKH ILWQHVV RI HDFK LQGLYLGXDO LV HYDOXDWHG EDVHG RQ PXOWLSOH REMHFWLYH IXQFWLRQV 7KH JRDO RI 02($V LV WR ILQG D VHW RI 3DUHWR RSWLPDO VROXWLRQV 1RQGRPLQDWHG 6RUWLQJ *HQHWLF $OJRULWKP 16*$ LV RQH RI WKH PRVW SRSXODU 022 DOJRULWKPV WKDW XVHV WKH JHQHWLF DOJRULWKP *$ DV D VHDUFK PHWKRG 16*$LL ZDV ILUVW LQWURGXFHG E\ 'HE HW DO