A Computational Framework for Cloud based Machine Prognosis Procedia CIRP 57 ( 2016 ) 309 – 314 Available online at www sciencedirect com 2212 8271 © 2016 Published by Elsevier B V This is an open acc[.]
Available online at www.sciencedirect.com ScienceDirect Procedia CIRP 57 (2016) 309 – 314 WK&,53&RQIHUHQFHRQ0DQXIDFWXULQJ6\VWHPV&,53&06 $&RPSXWDWLRQDO)UDPHZRUNIRU&ORXG%DVHG0DFKLQH3URJQRVLV 3HQJ:DQJD5REHUW;*DRD 'D]KRQJ:XEDQG-DQLV7HUSHQQ\E a Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH 44016, USA Department of Industrial and Manufacturing Engineering, Pennsylvania State University, University Park, PA 16802, USA b Tel.faxE-mail address:5REHUW*DR#FDVHHGX $EVWUDFW 3URJQRVLVRIPDFKLQHGHJUDGDWLRQDQGIDLOXUHSURSDJDWLRQLVHVVHQWLDOWRSUHYHQWDWLYHPDLQWHQDQFHVFKHGXOLQJDQGVXVWDLQDEOHPDQXIDFWXULQJ (PHUJLQJWHFKQRORJLHVVXFKDV,QWHUQHWRI7KLQJV,R7DQGFORXGFRPSXWLQJRIIHUQHZRSSRUWXQLWLHVIRUVFDOLQJXSFRPSXWLQJSHUIRUPDQFH DQGFDSDFLW\IRUPDFKLQHPRQLWRULQJDQGSURJQRVLV7KLVSDSHUDGGUHVVHVFKDOOHQJHVLQPDFKLQHSURJQRVLVGXHWRKLJKVSHHGGDWDVWUHDPLQJ IURPUHDOWLPHVHQVLQJE\OHYHUDJLQJSDUDOOHOFRPSXWLQJRQWKHFORXG$IUDPHZRUNIRUFORXGEDVHGSURJQRVLVLVWKHQSUHVHQWHGWRPRGHOWKH UHODWLRQVKLSVEHWZHHQKLGGHQPDFKLQHVWDWHVDQGVHQVRUPHDVXUHPHQWVXQGHUYDU\LQJRSHUDWLQJFRQGLWLRQVDQGPDLQWHQDQFHDFWLRQV7RDFFRXQW IRUXQFHUWDLQWLHVDVVRFLDWHGZLWKPRGHOUHSUHVHQWDWLRQDQGRUPHDVXUHPHQWTXDOLW\HDFKUHODWLRQVKLSLVPRGHOHGDVDSUREDELOLW\GLVWULEXWLRQ DQG HVWLPDWHG WKURXJK HLWKHU PRGHOEDVHG HJ SDUWLFOH ILOWHULQJ RU GDWDGULYHQ DOJRULWKPV HJ VXSSRUW YHFWRU PDFKLQH DFFRUGLQJ WR WKH DYDLODEOHSK\VLFDOPDWKHPDWLFDOGHVFULSWLRQRIWKHUHODWLRQVKLS$FRPSOHWHSURJQRVWLFPRGHORIWKHPDFKLQHLVWKHQFRQVWUXFWHGE\PHUJLQJ WKH LQGLYLGXDO SUREDELOLW\ GLVWULEXWLRQV 7KH FRPSXWDWLRQDO SURFHVV LV LPSOHPHQWHG RQ WKH 0DS5HGXFHEDVHG FORXG FRPSXWLQJ SODWIRUP 3URJQRVLV RI WKH HQWLUH PDFKLQH LV DFFRPSOLVKHG E\ DJJUHJDWLQJ SURJQRVLV UHVXOWV RI WKH LQGLYLGXDO FRPSRQHQWV WKURXJK D VHSDUDWH SDUDOOHO FRPSXWLQJSURFHVV7KHSURSRVHGIUDPHZRUNLVH[SHULPHQWDOO\GHPRQVWUDWHGXVLQJWRROGDWDFROOHFWHGIURP&1&PDFKLQHV © 2016 Published by Elsevier B.V This is an open access article under the CC BY-NC-ND license 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9 (http://creativecommons.org/licenses/by-nc-nd/4.0/) 3HHUUHYLHZXQGHUUHVSRQVLELOLW\RI6FLHQWLILFFRPPLWWHHRIWKHWK&,53&RQIHUHQFHRQ0DQXIDFWXULQJ6\VWHPV&,53&06 Peer-review under responsibility of the scientific committee of the 49th CIRP Conference on Manufacturing Systems Keywords:SURJQRVWLFPRGHOLQJSDUDOOHOFRPSXWLQJFORXGPDQXIDFWXULQJ ,QWURGXFWLRQ 7KH RSHUDWLRQDO UHOLDELOLW\ RI LQGXVWULDO PDFKLQHV DQG DVVHWV VLJQLILFDQWO\ LQIOXHQFHV WKH VXVWDLQDELOLW\ RI PDQXIDFWXULQJ DQG FRPSHWLWLYHQHVV RI WKH LQGXVWU\ +HQFH HQVXULQJ UHOLDELOLW\ GXULQJ WKH GHVLJQHG OLIHF\FOH RI WKH PDFKLQH EHFRPHV D FULWLFDO WDVN IRU PDLQWHQDQFH &RPSDUHG WR WUDGLWLRQDO VFKHGXOHG PDLQWHQDQFH FRQGLWLRQEDVHG PDLQWHQDQFH SUHGLFWLYH PDLQWHQDQFH WKDW LQWHJUDWH FRQGLWLRQ PRQLWRULQJ ZLWK UHOLDEOH SURJQRVWLF WHFKQLTXHV FDQ PLQLPL]H WKH PDFKLQH GRZQWLPH PDLQWHQDQFH FRVW DQG UHOLDQFH RQ KXPDQ H[SHULHQFH IRU PDLQWHQDQFH VFKHGXOLQJ 6SHFLILFDOO\ SURJQRVWLFWHFKQLTXHVFDQKHOSTXLFNO\GHWHUPLQHDPDFKLQH¶V IXQFWLRQDO GHWHULRUDWLRQ SUHGLFW LWV UHPDLQLQJ XVHIXO OLIH 58/DQGLGHQWLI\WKHDSSURSULDWHVKRUWWHUPDQGORQJWHUP PDLQWHQDQFHDFWLRQV>@ *HQHUDOO\ SURJQRVWLF WHFKQLTXHV FDQ EH FODVVLILHG LQWR WKUHH FDWHJRULHV SK\VLFVEDVHG GDWDGULYHQ DQG PRGHO EDVHG DFFRUGLQJ WR WKH UHTXLUHG LQIRUPDWLRQ DQG WKH W\SH RI SUHGLFWLRQ UHVXOWV >@ 3K\VLFVEDVHG WHFKQLTXHV PRGHO WKH GHJUDGDWLRQRISK\VLFDOTXDQWLW\RILQWHUHVWHJFUDFNZHDU ZLWK SK\VLFDO DQGRU HPSLULFDO IRUPXODH ZKHUH UHODWHG SDUDPHWHUVFRHIILFLHQWV DUH WKHQ GHWHUPLQHG WKURXJK UHJUHVVLRQEDVHGRQDODUJHPRXQWRIH[SHULPHQWDOGDWD'DWD GULYHQ PHWKRGV QXPHULFDOO\ WUDLQ D EODFNER[ PRGHO WKDW FKDUDFWHUL]HV WKH UHODWLRQVKLS EHWZHHQ D PDFKLQH¶V FXUUHQW GDPDJH VWDWH UHSUHVHQWHG E\ VHQVRU GDWD RU H[WUDFWHG IHDWXUHV DQG IXWXUH KHDOWK VWDWH 6LQFH QR SULRU SK\VLFDO NQRZOHGJH LV QHHGHG LQ WKH PRGHOLQJ SURFHVV GDWDGULYHQ PHWKRGV DUH HVSHFLDOO\ SUHIHUDEOH IRU PRQLWRULQJ DQG SUHGLFWLRQ RI FRPSOH[ F\EHUSK\VLFDO V\VWHP LQ SUDFWLFH 0RGHOEDVHG SURJQRVWLF WHFKQLTXHV FRPELQH WKH DERYH PHQWLRQHG WZR PHWKRGV WR LPSURYH WKH SUHGLFWLRQ DFFXUDF\ 2212-8271 © 2016 Published by Elsevier B.V This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer-review under responsibility of the scientific committee of the 49th CIRP Conference on Manufacturing Systems doi:10.1016/j.procir.2016.11.054 310 Peng Wang et al / Procedia CIRP 57 (2016) 309 – 314 DQG UREXVWQHVV ,W SK\VLFDOO\PDWKHPDWLFDOO\ PRGHOV WKH V\VWHP GHJUDGDWLRQ SURFHVV ZKLFK LV WKHQ HPEHGGHG LQ D ILOWHULQJ PHWKRG WR LQIHU WKH SK\VLFDO TXDQWLW\ RI LQWHUHVW V\VWHP VWDWH EDVHG RQ VHQVRU GDWD PHDVXUHPHQW 2QH DGYDQWDJH RI PRGHOEDVHG SURJQRVWLF PHWKRGV LV WKDW LW LV FDSDEOH RI DFFRXQWLQJ IRU WKH VWRFKDVWLFLW\ RI GHJUDGDWLRQ SURFHVV DQG QRLVH DIIHFWLQJ PHDVXUHPHQWV >@ DOPDQ ILOWHU )DQGSDUWLFOHILOWHU3)DUHWZRUHSUHVHQWDWLYHVLQPRGHO EDVHG DSSURDFK &RPSDUHGWR ) 3) KDVPRUH FDSDELOLW\WR FKDUDFWHUL]HQRQOLQHDUDQGQRQ*DXVVLDQV\VWHPDQGSURFHVV 7KHUHIRUH3)LVPDLQO\LQYHVWLJDWHGLQWKLVSDSHU>@ 0RWLYDWHG E\ WKH SRWHQWLDO RI FORXG FRPSXWLQJ DQG FORXG PDQXIDFWXULQJ>@FORXGEDVHGSURJQRVLVUHSUHVHQWVDQHZ W\SH RI VHUYLFHRULHQWHG WHFKQRORJ\ &RQGLWLRQ PRQLWRULQJ GDWD>@FROOHFWHGLQVKRSIORRUDUHUHPRWHO\WUDQVIHUUHGWRWKH FORXG SODWIRUP LQ ZKLFK GLDJQRVWLF DQG SURJQRVWLF DQDO\VLV DUH SUHIRUPHG DQG H[SHUWLVH RQ SUHGLFWLYH PDLQWHQDQFH SODQQLQJ DUH SURYLGHG WR FXVWRPHUV &ORXGEDVHG SURJQRVLV KDVWKUHHFKDUDFWHULVWLFV>@ x ,PSURYHG DFFHVVLELOLW\ DQG UREXVWQHVV %\ RIIHULQJ DQ LQWHJUDWHG VROXWLRQ WR RQGHPDQG DQG FRQILJXUDEOH SURJQRVWLF VHUYLFHV FORXG FDQ LQFUHDVH WKH UREXVWQHVV RI SURJQRVLV RI PDQXIDFWXULQJ SURFHVVHV ,Q DGGLWLRQ FXVWRPHUV FDQ DFFHVV WKH VHUYLFH ZKHQHYHU DQG ZKHUHYHUWKURXJK,QWHUQHWFRQQHFWHGSURGXFWV x ,PSURYHG FRPSXWDWLRQDO HIILFLHQF\ DQG GDWD VWRUDJH &ORXG FRPSXWLQJ SURYLGHV HQKDQFHG FRPSXWDWLRQDO SRZHUIRUFRPSOH[FDOFXODWLRQVHQDEOHGE\HODVWLFGDWD VWRUDJHDQGHIILFLHQWSDUDOOHOFRPSXWLQJPRGH x &ROODERUDWLRQ DQG GLVWULEXWLRQ 7KH FORXG HQDEOHV WUHDWLQJ PDFKLQH SURJQRVLV DV D UHPRWH DQG SD\DV \RXJRVHUYLFHLQVWHDGRIDORFDOFHQWUDOL]HGFDSDELOLW\ 7KURXJK LQIRUPDWLRQ DQG GDWD VKDULQJ UHDOL]HG E\ FURZGVRXUFLQJFORXGDOVRSURYLGHVPRUHHIIHFWLYHDQG HIILFLHQWVHOHFWLRQRISURJQRVWLFPRGHOVDVZHOODVGDWD LQWHUSUHWDWLRQ 7KLVSDSHUPDLQO\IRFXVHVRQWKHFRPSXWDWLRQDOHIILFLHQF\ RI SURJQRVLV OHYHUDJHG E\ FORXG FRPSXWLQJ 6SHFLILFDOO\ H[HFXWLRQRISURJQRVLVRQFORXGEDVHGRQSDUDOOHOFRPSXWLQJ FDQEHFODVVLILHGLQWRWZRPRGHV x 3DUDOOHO SURJQRVWLF PRGHOLQJ $IWHU UHPRWHO\ DQG G\QDPLFDOO\ WUDQVIHUUHG WR FORXG SODWIRUP XSORDGHG FRQGLWLRQ PRQLWRULQJ DQG SURFHVV GDWD DUH SDUWLWLRQHG DQG VWRUHG LQ PXOWLSOH VWRUDJH GHYLFHV FRUUHVSRQGLQJ WR GLIIHUHQW PDFKLQHVFRPSRQHQWV 7KHQ LQGLYLGXDO PDFKLQHFRPSRQHQW¶V GDWD FDQ EH SURFHVVHG LQGLYLGXDOO\ E\ RQH VHOHFWHG SURJQRVWLF WHFKQLTXH DFFRUGLQJWRWKHVSHFLILFGDWDW\SHVDQGSK\VLFVRIWKH PRQLWRUHGPDFKLQHVFRPSRQHQWV x 3DUDOOHO SURJUDP H[HFXWLRQ 6LPLODU WR GDWD SDUWLWLRQ VLQJOH SURJQRVWLF SURJUDP FDQ DOVR EH SDUWLWLRQHG DQG H[HFXWHG E\ SDUDOOHO FRPSXWLQJ HVSHFLDOO\ IRU WKRVH DOJRULWKPV WKDW UHTXLUH ODUJH DPRXQW RI FRPSXWDWLRQDO ORDG VXFK DV SDUWLFOH ILOWHU EDVHG RQ 0RQWH &DUOR VDPSOLQJ %XW WKLV UHTXLUHV WKH DOJRULWKP LV SDUWLWLRQDEOH 3) LV D DSSURSULDWH FDQGLGDWH IRU WKLV FRPSXWDWLRQPRGHVLQFHSDUWLFOHVLQ3)LQGHSHQGHQWO\ SHUIRUPWKHVWDWHSUHGLFWLRQDQGZHLJKWXSGDWH 'DWDSURFHVVLQJLQFORXGPDQXIDFWXULQJ Infrastructure of cloud manufacturing and prognosis 0RWLYDWHG E\ FORXG FRPSXWLQJ FORXG PDQXIDFWXULQJ FDQ EH UHJDUGHG DV DQ LQWHJUDWHG F\EHUSK\VLFDO V\VWHP WKDW FDQ SURYLGH RQGHPDQG PDQXIDFWXULQJ VHUYLFHV GLJLWDOO\ DQG SK\VLFDOO\ WR EHVW XWLOL]H PDQXIDFWXULQJ UHVRXUFHV >@ 0DFKLQHSURJQRVLVDVRQHSDUWLQPDQXIDFWXULQJFDQDOVREH OHYHUDJHGE\FORXGFRPSXWLQJDQGSURYLGHUHVLOLHQWDQGSD\ DV\RXJR VHUYLFH 3URFHVV DQG FRQGLWLRQ PRQLWRULQJ GDWD FROOHFWHG IURP VKRS IORRU DUH G\QDPLFDOO\ DQG UHPRWHO\ XSORDGHG WR FORXG ZKHUH GDWD DUH SURFHVVHG ZLWK HQKDQFHG FRPSXWLQJFDSDELOLW\7KHREWDLQHGGLDJQRVWLFDQGSURJQRVWLF UHVXOWV DUH WKHQ LQWHUSUHWHG E\ H[SHUWV DQG H[SHUWLVH DUH SURYLGHGWRFXVWRPHUVRQPDLQWHQDQFHSODQQLQJDQGLQYHQWRU\ PDQDJHPHQW >@ 7KH VWUXFWXUH RI FORXGEDVHG SURJQRVLV LV VKRZQLQ)LJ )LJ,QIUDVWUXFWXUHRIFORXGEDVHGSURJQRVLV Data streaming and parallel computing 7KH VXSSRUWLQJ WHFKQLTXHV IRU FORXG PDQXIDFWXULQJ DQG FORXGEDVHG SURJQRVLV LQFOXGH ,QWHUQHW RI 7KLQV ,R7 DQG 07&RQQHFW >@ :KLOH ,R7 LQWHJUDWHV SK\VLFDO DVVHWV LQWR RQH LQIRUPDWLRQ QHWZRUN 07&RQQHFW HQDEOHV PDFKLQHWR PDFKLQH FRPPXQLFDWLRQ YLD D VWDQGDUG FRPPXQLFDWLRQ SURWRFRO 7KURXJK D XQLILHG LQWHUIDFH EHWZHHQ GLIIHUHQW GDWD VRXUFHV DQG W\SHV HJ (WKHUQHW 56 VHULDO SRUW DQG 86%07&RQQHFWLPSURYHVWKH LQWHURSHUDELOLW\RI FROOHFWHG GDWDDQGUHGXFHWKHSURFHVVLQJFRPSOH[LW\RQFORXG 2QH PDMRU DGYDQWDJH RI FORXG FRPSXWLQJ EHQHILW RQ PDQXIDFWXULQJDQGSURJQRVLVLVLWVHQKDQFHGGDWDVWRUDJHDQG SURFHVVLQJFDSDELOLW\7KHXSORDGHGGDWDDUHG\QDPLFDOO\DQG UHVLOLHQWO\ DOORFDWHG WR GLVWULEXWHG VWRUDJH GHYLFHV ZKLFK DUH PDQDJHGE\DK\SHUYLVRU'DWDIURPGLIIHUHQWVWRUDJHGHYLFHV FDQ WKHQ EH URXWHG WR GLIIHUHQW GHYLFHV WR SHUIRUP VSHFLILF IXQFWLRQV LQ SDUDOOHO 7KH LQYRNLQJ RI GDWD DOORFDWLRQ RI SURFHVVRUV DQG UHVXOWV IXVLRQ DUH DOO FRQWUROOHG E\ D SURJUDPPLQJ PRGHO VXFK DV 0DS5HGXFH >@ 7KH GLVWULEXWHG GDWD VWRUDJH DQG SDUDOOHO FRPSXWLQJ HQDEOHV SDUDOOHO SURJQRVWLF PRGHOLQJ DQG SURJUDP H[HFXWLRQ ZKLFK ZLOOEHGLVFXVVHGLQGHWDLOLQ6HFWLRQ 311 Peng Wang et al / Procedia CIRP 57 (2016) 309 – 314 3URJQRVLVLQPDQXIDFWXULQJ 3.1 Prognostic modeling 3URJQRVWLF PRGHOLQJ FKDUDFWHUL]HV WKH PDFKLQH GHJUDGDWLRQ LQ QXPHULFDO IRUPXODH 3URJQRVWLF PHWKRGV LV UHTXLUHGWREHFDSDEOHWR x 7UDFN ERWK JUDGXDO GHWHULRUDWLRQ DQG DEUXSW IDXOW RFFXUUHQFH7KHDEUXSWIDXOWDVDUHVXOWRIDFFXPXODWHG GHWHULRUDWLRQ RU IRUHLJQ REMHFW GDPDJH FDQ OHDG WR WUDQVLHQWSHUIRUPDQFHFKDQJHDQGYDU\LQJGHWHULRUDWLRQ UDWHVUHVXOWLQJLQXQVFKHGXOHGPDLQWHQDQFH x (YDOXDWH XQFHUWDLQW\ RI SUHGLFWLRQ UHVXOWV 7KH XQFHUWDLQWLHV FRPH IURP WKH SURFHVV UDQGRPQHVV DQG PHDVXUHPHQW QRLVH ,W LV H[SHFWHG WKDW WKH FRQILGHQFH LQWHUYDOVFDQEHSURYLGHGEHVLGHVSUHGLFWLRQYDOXHV x $GDSW WR EURDGHU DSSOLFDWLRQV $ SURJQRVLV PRGHO GHYHORSHG EDVHG XSRQ VSHFLILHG PDFKLQH DQG PHDVXUHPHQW FDQ EH DSSOLFDEOH WR WKH SURJQRVLV RI RWKHUPDFKLQHVRUHYHQWKHVDPHW\SHRIPDFKLQHVLQD GLIIHUHQWRSHUDWLRQHQYLURQPHQW 7R DGGUHVV WKH DERYH FKDOOHQJHV D K\EULG SURJQRVWLF PRGHO WDNLQJ DGYDQWDJH RI PRGHOEDVHG DQG GDWDGULYHQ SURJQRVWLF PHWKRGV LV SURSRVHG WR LQFOXGH YDU\LQJ IDFWRUV VXFK DV PHDVXUHPHQW PDFKLQH VHWWLQJV DQG PDLQWHQDQFH DFWLRQV LQWR WKH PRGHOLQJ 7KH VWUXFWXUH RI WKH SURSRVHG PRGHOLQJ LV VKRZQ LQ )LJ :KHQ SK\VLFDO NQRZOHGJH RU H[SHULHQWLDOLQIRUPDWLRQLVDYDLODEOHDQDQDO\WLFDOPRGHOFDQ EHHVWDEOLVKHGXVLQJSK\VLFDOLQIRUPDWLRQDQGWKHQGHWHUPLQHG E\ D PRGHOEDVHG DSSURDFK VXFK DV SDUWLFOH ILOWHU )RU H[DPSOH WRRO ZHDU FDQ EH ILUVW PRGHOHG EDVHG RQ H[WHQGHG 3DULV ODZ >@ LQ ZKLFK WKH XQNQRZQ SDUDPHWHUV WKDW GHVFULEHV WKH HIIHFW RI ZRUNSLHFH PDWHULDO DQG PDFKLQH VHWWLQJV DUH WKHQ XSGDWHG EDVHG RQ VHQVRU GDWD HJ IRUFH YLEUDWLRQE\3) 7R FRQVLGHU WKH HIIHFW RI PDLQWHQDQFH DFWLRQV DQG RWKHU IDFWRUV WKDW HIIHFWV RQ V\VWHP GHJUDGDWLRQ DUH XQTXDQWLILDEOH LQ SK\VLFV D GDWDGULYHQ DSSURDFK LV DGRSWHG 7R PDWFK SUHGLFWLRQ UHVXOWV SUREDELOLW\ GLVWULEXWLRQ IURP WKH PRGHO EDVHG DSSURDFK WKH UHODWLRQVKLSV HVWLPDWHG E\ D GDWDGULYHQ DSSURDFK FDQ ILUVW EH FKDUDFWHUL]HG DV D FHUWDLQ SUREDELOLW\ GLVWULEXWLRQ)RUH[DPSOHPDLQWHQDQFHDFWLRQFDQEHPRGHOHG DV D :HLEXOO GLVWULEXWLRQ LQ ZKLFK SDUDPHWHUV DUH WKHQ HVWLPDWHG E\ PDFKLQH OHDUQLQJ PHWKRGV VXFK DV VXSSRUW YHFWRU UHJUHVVLRQ $V D UHVXOW WKH V\VWHP GHJUDGDWLRQ LV GHVFULEHG E\ PXOWLSOH SUREDELOLW\ GLVWULEXWLRQV FRQVLGHULQJ GLIIHUHQW IDFWRUV WKDW DIIHFW GHJUDGDWLRQ SURFHVV )LQDOO\ PRGHO IXVLRQ RI SUREDELOLW\ GLVWULEXWLRQV LV SHUIRUPHG WR REWDLQDFRPSUHKHQVLYHSURJQRVWLFPRGHO 3.2 Implementation of prognosis based on particle filtering 7KH3)DOJRULWKPEDVHGRQ0RQWH&DUORPHWKRGHPSOR\V DVHWRIUDQGRPVDPSOHVSDUWLFOHV^ xki T ki I ki i «N` DQG DVVRFLDWHG LPSRUWDQFH ZHLJKWV wki WR DSSUR[LPDWH SUREDELOLW\ GLVWULEXWLRQV 3DUWLFOHV UHSUHVHQWLQJ V\VWHP VWDWHV DQG SDUDPHWHUV DUH LQWLDOO\ VDPSOHG IURP D SUREDELOLW\ GLVWULEXWLRQ HJ *DXVVLDQ GLVWULEXWLRQ DFFRUGLQJ WR D SULRU NQRZOHGJH*HQHUDOO\SURJQRVLVIXOILOOHGE\3)LQFOXGHVWZR LWHUDWLYH VWHSV SUHGLFWLRQ DQG XSGDWH >@ ,Q SUHGLFWLRQ VWHS IXWXUH V\VWHP VWDWH HJ WRRO ZHDU LV SUHGLFWHG EDVHG RQ FXUUHQW PHDVXUPHQW HJ IRUFH DQG YLEUDWLRQ GDWD DQG WKH SULRULQIRUPDWLRQFKDUDFWUL]LQJWKHZHDUSURJSDJDWLRQ p xk T k _ zk N | ¦ wki G xk T k xki T ki p xk T k _ xk T k N i k ¦w p xk T k _ xki T ki i ,Q (T V\PEROV x DQG ș GHQRWHV WKH V\VWHP VWDWH DQG SDUDPHWHUV GHVFULELQJ WKH HIIHFWV RI PDFKLQH VHWWLQJV DQG ZRUNSLHFHPDWHULDOUHVSHFWLYHO\6\PEROkGHQRWHVWKHWLPH 7HUP pxk șk| xk-1 șk-1 GHVFULELQJ WKH VWDWH HYROXWLRQ LV DVVXPHG WR EH NQRZQ DV D SULRUL (T WUDQVIRUPV WKH FDOFXODWLRQ RI SRVWHULRU SUREDELOLW\ GLVWULEXWLRQ WR ZHLJKWHG VXPRISULRULQIRUPDWLRQ:KHQQHZPHDVXUHPHQWLVDYDLODEOH WKH VWDWHV DQG SDUDPHWHUV DUH XSGDWHG WKURXJK XSGDWLQJ SDUWLFOHV¶ ZHLJKWV ZKLFK LV IXOILOOHG E\ FDOFXODWLQJ WKH OLNHOLKRRGRIWKHV\VWHPVWDWHJLYHQQHZPHDVXUHPHQW wki v wki p zk _ xki T ki )LJ6WUXFWXUHRIK\EULGSURJQRVWLFPRGHOLQJPHWKRG i wki SV ª zk g xki T ki ẳ e V 312 Peng Wang et al / Procedia CIRP 57 (2016) 309 – 314 ,Q (T g UHSUHVHQWV PHDVXUHPHQW IXQFWLRQ WKDW UHODWHV WKH VHQVRU GDWD z WR V\VWHP VWDWH x $Q LQKHUHQW SUREOHP DVVRFLDWHGZLWKWKHDERYHVWDQGDUGSDUWLFOHILOWHULVWKHSDUWLFOH GHJHQHUDF\ 7KLV UHIHUV WR WKH SKHQRPHQRQ ZKHUH ZHLJKWV RI PRVW SDUWLFOHV HJ RXWVLGH RI WKH VLJPDUDQJH RI WKH SRVWHULRU GLVWULEXWLRQ EHFRPH QHJOLJLEOH DIWHU VHYHUDO LWHUDWLRQV 7KLV LV FDXVHG E\ WKH PLVPDWFK EHWZHHQ WKH SRVWHULRU SGI WR EH HVWLPDWHG DQG WKH SULRU SGI IURP ZKLFK SDUWLFOHV DUH LQLWLDOO\ VDPSOHG 7R WDFNOH WKLV SUREOHP DQ DGDSWLYH UHVDPSOLQJ KDV EHHQ SURSRVHG LQ SUHYLRXV UHVHDUFK >@7KDWLVRQO\SDUWLFOHVZLWKODUJHZHLJKWVDUHVHOHFWHGWR HQWHUQH[WHVWLPDWLRQLWHUDWLRQDQGSDUWLFOHVDUHGLVSHUVHGIURP IL[HGSRVLWLRQVWRDZLGHUUDQJHE\DGGLQJSHUWXUEDWLRQV p xki Tki _ xki T ki v N xki Tki _ xki Tki h3ki ,Q(T3UHSUHVHQWVWKHSDUWLFOHYDULDQFHREWDLQHGIURP WKH HVWLPDWLRQ UHVXOW LQ WKH SUHYLRXV LWHUDWLRQ 6\PERO h GHQRWHVWKHVKULQNDJHFRHIILFLHQWZKLFKGHFUHDVHVWKURXJKRXW LWHUDWLRQ WR HQVXUH SDUWLFOHV JUDGXDOO\ FRQYHUJH RQ RSWLPDO HVWLPDWLRQ 7KH UHVDPSOLQJ SURFHVV LV DGGHG DIWHU WKH XSGDWH SURFHGXUH WR UHJXODWH SDUWLFOHV IRU SUHSDUDWLRQ RI QH[W HVWLPDWLRQ LWHUDWLRQ 7KH FRPSXWDWLRQDO FRPSOH[LW\ RI WKH ZKROH 3) DOJRULWKP SUHGLFWLRQ XSGDWH DQG UHVDPSOLQJ WKUHH VWHSVLVVXPPDUL]HGLQ7DEOH>@ 4.1 Parallel computing for prognostic modeling 6LQFHGLIIHUHQW PRQLWRULQJWHFKQLTXHVPD\ EHDGRSWHGIRU GLIIHUHQW PDFKLQHV GDWD FROOHFWHG IURP PDFKLQHV RU FRPSRQHQWVZLWKLQDPDFKLQHZLOOEHVHSDUDWHO\XSORDGHGRQ WRGLIIHUHQWVWRUDJHGLVNVDQGURXWHGLQWRGLIIHUHQWSURFHVVRUV YLD SURJUDPPLQJ PRGHOV VXFK DV 0DS5HGXFH DV VKRZQ LQ )LJ >@ +\SHUYLVRU LV UHVSRQVLEOH IRU DVVLJQLQJ VWRUDJHSURFHVVLQJUHVRXUFHVDQGPDQDJLQJWKHXSORDGHGGDWD 2QH DGYDQWDJH RI WKLV SDUDOOHO FRPSXWLQJ LV WKH SURJQRVWLF DOJRULWKPV UXQ LQ GLIIHUHQW SURFHVVRUV FDQ DGDSW WR VSHFLILF FRQGLWLRQ PRQLWRULQJ GDWD W\SHV DQG SK\VLFV RI PRQLWRUHG PDFKLQHVFRPSRQHQWV Result integration Processor Result Result Result n Processor Processor Processor n Disk Disk m Final result Mapreduce Hypervisor Disk Data allocation Remote data upload Key Value Data source 7DEOH&RPSXWDWLRQDOFRPSOH[LW\RI3) )LJ6WUXFWXUHRISDUDOOHOSURJQRVWLFPRGHOLQJ 2SHUDWLRQ 7HUP &RPSOH[LW\ 3UHGLFWLRQ (T k N nn mn 8SGDWH (T k N 5HVDPSOLQJ (T k anNnNnNrnN mn m ,Q 7DEOH n DQG m GHQRWHV WKH GLPHQVLRQ RI XQNQRZQ SDUDPHWHUV DQG PHDVXUHPHQWV UHVSHFWLYHO\ N GHQRWHV WKH QXPEHU RI SDUWLFOHV DQG k GHQRWHV WKH QXPEHU RI LWHUDWLRQV 6\PERO r UHSUHVHQWV WKH FRHIILFLHQW VDPSOLQJ IURP D QRUPDO GLVWULEXWLRQ DQG V\PERO a YDULHV ZLWK UHVDPSOLQJ VWUDWHJ\ ZKLFK LV DOZD\V OHVV WKDQ ,W FDQ EH VHHQ WKDW WKH WRWDO FRPSXWDWLRQDO FRPSOH[LW\ LV GHWHUPLQHG E\ WKH WHUP kanN QDPHO\ WKH FRPSXWDWLRQ WLPH LV GHWHUPLQHG PDLQO\ E\ WKH QXPEHURISDUWLFOHVVWDWHGLPHQVLRQDQGGDWDOHQJWK &ORXGEDVHGSURJQRVLV 2QH PDMRU DGYDQWDJH RI FORXG PDQXIDFWXULQJ DQG FORXG EDVHG SURJQRVLV LV WKH HQKDQFHG FDSDELOLW\ LQ UHVLOLHQW GDWD VWRUDJH DQG FRPSXWDWLRQ UHO\LQJ RQ WKH DJJUHJDWLRQ RI GLVWULEXWHG FRPSXWLQJ UHVRXUFHV DQG DGYDQFHG SDUDOOHO FRPSXWLQJ SURJUDP 7KLV LV HVSHFLDOO\ EHQHILFLDO LQ DSSOLFDWLRQV LQYROYLQJ ELJ GDWD VXFK DV WKH PRQLWRULQJ DQG SURJQRVLV RI D ODUJH DPRXQW RI PDFKLQHV LQ D IDFWRU\ 6SHFLILFDOO\ SURJQRVLV FDQ EH IXOILOOHG LQ WZR PRGHV RQ FORXG )LUVW 3URJQRVWLF PRGHOLQJ FDQ EH DFKLHYHG DW VXE PRGXOH RU FRPSRQHQW OHYHO ZLWK HDFK FRPSXWLQJ GHYLFH FRUUHVSRQGLQJ WR RQH PRGHOLQJ RI RQH PDFKLQH PRGXOH RU FRPSRQHQW ,Q DGGLWLRQ SURJQRVWLF DOJRULWKP FDQ EH SRUWLRQHGLQWRVXEWDVNVDQGH[HFXWHGRQPXOWLSOHSURFHVVRUV WRLPSURYHWKHFRPSXWDWLRQDOHIILFLHQF\ )RU H[DPSOH WKH WRRO ZHDU SURSDJDWLRQ FDQ EH PRGHOHG ZLWKH[SDQGHG3DULV¶ODZDV>@ ª xkD v A f B d C D tk t º C k ẳ ,Q (T SDUDPHWHUV AaD UHSUHVHQW WKH HIIHFWV RI FXWWLQJ VSHHGvIHHGUDWHfFXWWLQJGHSWKdDQGZRUNSLHFHPDWHULDORQ WRRO ZHDU JURZWK 6LQFH GLIIHUHQW PDFKLQH VHWWLQJV DQG ZRUNSLHFH PDWHULDO PD\ EH DSSOLHG LQ GLIIHUHQW FXWWLQJ PDFKLQHVWKHSDUDPHWHUVHVWLPDWHGE\3)XVLQJ(TVa PD\ EH GLIIHUHQW ZKLFK UHTXLUHV WKH SURJQRVLV RI GLIIHUHQW PDFKLQHV VKRXOG EH IXOILOOHG LQGHSHQGHQWO\ ,Q DGGLWLRQ GLIIHUHQW PHDVXUHPHQW OHDGV WR GLIIHUHQW PHDVXUHPHQW IXQFWLRQV g LQ (T ZKLFK VKRXOG DOVR EH WUHDWHG DFFRUGLQJO\ xk 4.2 Parallel computing for prognostic program execution &HUWDLQSURJQRVWLFDOJRULWKPVFDQEHSDUWLWLRQHGLQWRVXE WDVNV DQG OHYHUDJHG E\ SDUDOOHO FRPSXWLQJ 3DUWLFOH ILOWHU LV RQH UHSUHVHQWDWLYH ,Q 3) PXOWLSOH UDQGRPO\ VDPSOHG SDUWLFOHVDUHXWLOL]HGWRDSSUR[LPDWHDSUREDELOLW\GLVWULEXWLRQ WKURXJKVWDWHSUHGLFWLRQZHLJKWXSGDWHDQGUHVDPSOLQJWKUHH VWHSV DV LQWURGXFHG LQ 6HFWLRQ 7KH VWDWH SUHGLFWLRQ RI HDFK SDUWLFOH LV SHUIRUPHG GLUHFWO\ EDVHG RQ WKH VWDWH HYROXWLRQPRGHOpxkșk| xk-1șk-17KHZHLJKWXSGDWHRIHDFK SDUWLFOH UHOLHV RQ WKH QHZ PHDVXUHPHQW DQG OLNHOLKRRG H[SUHVVLRQ LQ (T +HQFH LQ WKHVH WZR VWHSV WKHUH LV QR LQWHUDFWLRQEHWZHHQSDUWLFOHVDQGSDUWLFOHVFDQEHDOORFDWHGWR PXOWLSOHSURFHVVRUVIRUSDUDOOHODQGLQGHSHQGHQWFRPSXWDWLRQ %XWDIWHUZDUGVDOOSDUWLFOHVZLWKXSGDWHGZHLJKWVQHHGWREH LQWHJUDWHG WR REWDLQ WKH EHVW HVWLPDWLRQ ZKLFK SOD\V D VLJQLILFDQW UROH LQ WKH SURSRVHG UHVDPSOLQJ SURFHVV 7KH 313 Peng Wang et al / Procedia CIRP 57 (2016) 309 – 314 LQGLFDWHG WKDW WKH PHGLDQ SUHGLFWLRQV EOXH OLQH PDWFK WKH WUXHZHDUVZHOO 7RROZHDUPP VWUXFWXUHRI3)UXQE\SDUDOOHOFRPSXWLQJLVVKRZQLQ)LJ 7KHDOORFDWLRQRIFRPSXWLQJSURFHVVRUVDQGUHVXOWIXVLRQDUH PDQDJHGE\K\SHUYLVRU Cutting depth: 1.5 mm Feed rate: 0.5 mm/rev 7RROZHDUPP 3UHGLFWHGZHDU 7UXHZHDU 7RROZHDUPP Cutting depth: 0.75 mm Feed rate: 0.5 mm/rev Cutting depth: 0.75 mm Feed rate: 0.25 mm/rev 7RROZHDUPP ,W VKRXOG EH QRWHG WKDW WKLV W\SH RI SDUDOOHO FRPSXWLQJ LV RQO\ DSSURSULDWH IRU SURJQRVWLF DOJRULWKPV WKDW FDQ EH SDUWLWLRQHG WR SDUDOOHO DQG LQGHSHQGHQW VXEWDVNV ,Q FRQWUDVW WR3).DOPDQILOWHUDVDVLQJOHLWHUDWLYHSURJUDPZLWKFXUUHQW LWHUDWLRQ GHSHQGHQW RQ SUHYLRXV LWHUDWLRQV¶ UHVXOWV FDQQRW EH H[HFXWHGLQSDUDOOHO$QRWKHUSUREOHPVKRXOGSD\DWWHQWLRQWR LV WKH FRPPXQLFDWLRQ RYHUKHDG FDXVHG E\ WKH UHJXODWLRQ RI K\SHUYLVRU RQ SURFHVVRUV DQG GDWD FRPPXQLFDWLRQV DPRQJ SURFHVVRUV7KLVLVIXUWKHUGLVFXVVHGLQIROORZLQJVHFWLRQ )LJ3DUWLFOHILOWHUDOJRULWKPOHYHUDJHGE\SDUDOOHOFRPSXWLQJ Cutting depth: 0.75 mm Feed rate: 0.25 mm/rev 7LPH PLQ )LJ7RROZHDUSUHGLFWLRQZLWKHUURUEDUVXQGHUGLIIHUHQW ([SHULPHQWDOHYDOXDWLRQ 7R HYDOXDWH WKH SHUIRUPDQFH RI SURSRVHG FORXGEDVHG SURJQRVLV PHWKRG FRQGLWLRQ PRQLWRULQJ GDWD RI WRRO WDNHQ IURP D 0DWVXXUD PLOOLQJ PDFKLQH 0&9 XQGHU GLIIHUHQW PDFKLQH VHWWLQJV >@ DUH DQDO\]HG 0RWRU FXUUHQW YLEUDWLRQ DQG DFRXVWLF HPLVVLRQ VHQVRUV DUH DGRSWHG WR PRQLWRU WKH PLOOLQJ SURFHVV DQG HVWLPDWH WRRO ZHDU 7KH GHVLJQ RI H[SHULPHQWVLVVKRZQLQ7DEOH(DFKWRROFDQEHVHHQDVDQ LQGHSHQGHQWFDVHWKHSURJQRVWLFPRGHOLQJRIZKLFKFDQWKHQ EHSHUIRUPHGLQSDUDOOHORQGLIIHUHQWSURFHVVRUVLQFORXG 7RRO 7RRO 7RRO 7RRO 7DEOH'HVLJQRIH[SHULPHQWV &XWWLQJGHSWK )HHGUDWH :RUNSLHFH dPP fPPUHY PDWHULDO &DVWLURQ &DVWLURQ &DVWLURQ 6WHHO ,QLWLDOO\ WKH XQNQRZQ SDUDPHWHUV AaD LQ (T WKDW GRPLQDWHV WKH WRRO ZHDU SURSDJDWLRQ DUH PRGHOHG DV SUREDELOLW\ GLVWULEXWLRQV IROORZLQJ D FHUWDLQ GLVWULEXWLRQ HJ XQLIRUPGLVWULEXWLRQLQWKLVSDSHU7KHVHSDUDPHWHUVDUHWKHQ LWHUDWLYHO\XSGDWHGEDVHGRQVHQVRUGDWDRUH[WUDFWHGIHDWXUHV E\ 3) WKURXJK (TV a >@ ZLWK WKH ODWHVW XSGDWHG SDUDPHWHUV XVHG IRU SUHGLFWLRQ ,W VKRXOG EH QRWHG WKDW WKH SDUDPHWHUV DUH DVVXPHG WR PDLQWDLQ FRQVWDQW XQGHU VDPH PDFKLQHVHWWLQJV7RGHPRQVWUDWHWKHVWDELOLW\DQGUREXVWQHVV RIWKHSURSRVHGSURJQRVWLFPRGHOLQJDOJRULWKPEDVHGRQ3)D 0RQWH&DUORVLPXODWLRQUHVXOWVIRUWRROVDUHVKRZQLQ)LJ (DFKSURJQRVWLFFDVHKDVEHHQUXQIRUWLPHV7KHUHVXOWV )LJ&RPSXWDWLRQDOWLPHRISURJQRVWLFPRGHOLQJZLWKGLIIHUHQW QXPEHURISURFHVVRUVDQGSDUWLFOHV 7R TXDQWLI\ WKH FRPSXWDWLRQDO ORDG RI WKH SURJQRVWLF PRGHOLQJPHWKRGGDWDRIWKHIRXUWRROVKDYHEHHQUXQDVRQH VLQJOHSURJUDPRQ ORFDOFRPSXWHU DQGDVIRXUSDUDOOHOFDVHV RQFORXGSODWIRUP7KHORFDOFRPSXWHULVZLWKFRUHVRI *+]&38DQG*%5$07KHKDUGZDUHFRQILJXUDWLRQRIWKH FORXGV\VWHPLQFOXGH/LQX[&RPPXQLW\(QWHUSULVH2SHUDWLQJ 6\VWHP &HQW26 ,QWHO ;HRQ 3URFHVVRU (: ZLWK *+] RI EDVH IUHTXHQF\ DQG *% 5$0 7KH FRPSXWDWLRQ WLPH ZLWK GLIIHUHQW QXPEHU RI SURFHVVRUV DQG SDUWLFOHV DUH VKRZQ LQ )LJ LQ ZKLFK N UHSUHVHQWV WKH QXPEHU RI SURFHVVRUV DQG N GHQRWHV WKH FRPSXWDWLRQ RQ ORFDO FRPSXWHU 7KH UHVXOWV LQGLFDWH WKDW WKH FRPSXWDWLRQDO WLPH GHFUHDVH DOPRVW LQ D OLQHDU ZD\ ZLWK WKH LQFUHDVH RI SURFHVVRUVZKHQWKHQXPEHURISDUWLFOHVLVODUJHUWKDQ %XWLWLVDOVRQRWHGWKDWWKHQXPEHURISDUWLFOHVGRQRWDIIHFW WKHFRPSXWDWLRQDOWLPHPXFKZKHQWKHQXPEHULVVPDOODQGRU WKH QXPEHU RI SURFHVVRUV H[FHHG WKH QXPEHU RI SURJQRVWLF FDVHV 7KLV LV PDLQO\ FDXVHG E\ ODUJH FRPPXQLFDWLRQ RYHUKHDG DPRQJ SURFHVVRUV ZKLFK FRPSHQVDWHV WKH DGYDQWDJHVRISURFHVVLQJVSHHGE\PRUHSURFHVVRUV 7R HYDOXDWH WKH SHUIRUPDQFH RI SDUDOOHO 3) H[FXWLRQ DQRWKHU VHW RI WRRO ZHDU GDWD ZLWK PRUH VDPSOLQJ SRLQWV LV SURFHVVHG >@ $V VKRZQ LQ )LJ PHDVXUHPHQWV EHIRUH 314 Peng Wang et al / Procedia CIRP 57 (2016) 309 – 314 WKFXWDUHXVHGWRWUDLQWKHSDUDPHWHUVLQSURJQRVWLFPRGHO ZKLFK LV WKHQ XWLOL]HG IRU ZHDU SUHGLFWLRQ (DFK SDUWLFOH GHOLYHUVRQHSUHGLFWLRQGHQRWHGE\WKHJUH\OLQH:KHQWKH SURSDJDWHGZHDUDSSURDFKHVQRUPDOL]HGYDOXHWKHWRROLV FRQVLGHUHG DV IDLOXUH $ GLVWULEXWLRQ RI 58/ FDQ WKHQ EH REWDLQHG,WLVLQGLFDWHGLQ7DEOHWKDWWKHSUHGLFWLRQDFFXUDF\ LQFUHDVHV LQ JHQHUDO ZLWK WKH QXPEHU RI SDUWLFOHV N 7KH FRPSXWDWLRQDO WLPH LV VKRZQ LQ )LJ IURP ZKLFK VLPLODU UHVXOW FDQ EH REWDLQHG DV LQ )LJ WKDW FRPSXWDWLRQDO HIILFLHQF\FDQEHLPSURYHGZLWKSDUDOOHOFRPSXWLQJRQFORXG SODWIRUPHVSHFLDOO\ZKHQWKHQXPEHURISDUWLFOHVDUHKLJK E\ SURFHVV UDQGRPQHVV DQG PHDVXUHPHQW QRLVH 7KH SURJQRVWLFPRGHOLQJFDQEHSHUIRUPHGLQSDUDOOHOIRUYDULRXV PDFKLQHV DFFRUGLQJ WR WKHLU VSHFLILF SK\VLFV DQG VHQVLQJ WHFKQLTXHV ,Q DGGLWLRQ FHUWDLQ SURJQRVWLF DOJRULWKP FDQ EH SDUWLWLRQHG WR VXEWDVNV DQG H[HFXWHG LQ SDUDOOHO XVLQJ WKH 0DS5HGXFH IUDPHZRUN 8VLQJ WRRO ZHDU PRQLWRULQJ DQG SUHGLFWLRQ DV DQ H[DPSOH WKH SDSHU KDV GHPRQVWUDWHG WKH HIIHFWLYHQHVV DQG FRPSXWDWLRQDO HIILFLHQF\ RI WKH SURSRVHG IUDPHZRUN IRU FORXGEDVHG PDFKLQH SURJQRVLV 7KH UHVXOWV LQGLFDWH WKDW WKH FORXG FRPSXWLQJ FDQ VLJQLILFDQWO\ LQFUHDVH WKHFRPSXWLQJHIILFLHQF\IRUWRROZHDUSUHGLFWLRQ $FNQRZOHGJHPHQWV 7KLV UHVHDUFK KDV EHHQ SDUWLDOO\ VXSSRUWHG E\ 1DWLRQDO 6FLHQFH )RXQGDWLRQ XQGHU JUDQWV &&) DQG &00, 5HIHUHQFHV )LJ3UHGLFWLRQRIWRROZHDUDQG58/EDVHGRQSDUUHO3) 7DEOH0RQWH&DUORVLPXODWLRQUHVXOWVZLWKGLIIHUHQWN N=2500 N=5000 N=10000 Mean 3.40% 3.01% 2.79% 1.41% 1.36% Variance 0.05% 0.04% 0.03% @ -DUGLQH $.6 /LQ ' %DQMHYLF ' $ UHYLHZ RQ PDFKLQHU\ GLDJQRVWLFV DQG SURJQRVWLFV LPSOHPHQWLQJ FRQGLWLRQEDVHG PDLQWHQDQFH 0HFKDQLFDO6\VWHPVDQG6LJQDO3URFHVVLQJ >@ 6LNRUVND -= +RGNLHZLF] 0 0D / 3URJQRVWLF PRGHOOLQJ RSWLRQV IRU UHPDLQLQJ XVHIXO OLIH HVWLPDWLRQ E\ LQGXVWU\ 0HFKDQLFDO 6\VWHPV DQG 6LJQDO3URFHVVLQJ >@ :DQJ - :DQJ 3 *DR 5 7RRO OLIH SUHGLFWLRQ IRU VXVWDLQDEOH PDQXIDFWXULQJ 3URFHHGLQJV RI WKH WK *OREDO &RQIHUHQFH RQ 6XVWDLQDEOH 0DQXIDFWXULQJ SS %HUOLQ *HUPDQ\ 6HSWHPEHU >@ :DQJ/:DQJ;9*DR/9iQF]D-$FORXGEDVHGDSSURDFKIRUZHHH UHPDQXIDFWXULQJ &,53 $QQDOV ± 0DQXIDFWXULQJ 7HFKQRORJ\ >@ :X ' 5RVHQ ': :DQJ / 6FKDHIHU ' &ORXGEDVHG GHVLJQ DQG PDQXIDFWXULQJ D QHZ SDUDGLJP LQ GLJLWDO PDQXIDFWXULQJ DQG GHVLJQ LQQRYDWLRQ&RPSXWHU$LGHG'HVLJQ >@ 7HWL 5 -HPLHOQLDN 2¶'RQQHOO * 'RUQIHOG ' DGYDQFHG PRQLWRULQJ RI PDFKLQLQJ RSHUDWLRQV &,53 $QQDOV0DQXIDFWXULQJ 7HFKQRORJ\ >@ :X ' *UHHU 0- 5RVHQ ': 6FKDHIHU ' &ORXG PDQXIDFWXULQJ VWUDWHJLF YLVLRQ DQG VWDWHRIWKHDUW -RXUQDO RI 0DQXIDFWXULQJ 6\VWHPV >@ ;X ; )URP &ORXG &RPSXWLQJ WR &ORXG 0DQXIDFWXULQJ 5RERWLFV DQG &RPSXWHU,QWHJUDWHG0DQXIDFWXULQJ± >@ :DQJ 3 *DR 5 )DQ = &ORXG FRPSXWLQJ IRU FORXG PDQXIDFWXULQJ EHQHILWV DQG OLPLWDWLRQV -RXUQDO RI 0DQXIDFWXULQJ 6FLHQFH DQG (QJLQHHULQJLQSUHVV >@ 07&RQQHFW ,QVWLWXWH 07&RQQHFW Y KWWSZZZPWFRQQHFWRUJGRZQORDGVVWDQGDUGDVS[ >@ =KDQJ 4 &KHQJ / %RXWDED 5 &ORXG FRPSXWLQJ VWDWHRIWKHDUW DQG UHVHDUFKFKDOOHQJHV-RXUQDORI,QWHUQHW6HUYLFHVDQG$SSOLFDWLRQV >@ :DQJ - :DQJ 3 *DR 5 (QKDQFHG SDUWLFOH ILOWHU IRU WRRO ZHDU SUHGLFWLRQ-RXUQDORI0DQXIDFWXULQJ6\VWHPV >@ :DQJ 3 *DR 5 $GDSWLYH UHVDPSOLQJEDVHG SDUWLFOH ILOWHULQJ IRU WRRO OLIHSUHGLFWLRQ-RXUQDORI0DQXIDFWXULQJ6\VWHPV >@ $JRJLQR$*RHEHO. %(67ODE8& %HUNHOH\0LOOLQJGDWDVHWQDVD DPHV SURJQRVWLFV GDWD UHSRVLWRU\ 1$6$ $PHV 5HVHDUFK &HQWHU 0RIIHWW)LHOG&$ >@ /L ; /LP %6 =KRX -+ +XDQJ 6 3KXD 6- 6KDZ & (U 0- )X]]\ QHXUDO QHWZRUN PRGHOOLQJ IRU WRRO ZHDU HVWLPDWLRQ LQ GU\ PLOOLQJ RSHUDWLRQ 3URF RI $QQXDO &RQIHUHQFH RI WKH 3URJQRVWLFV DQG +HDOWK 0DQDJHPHQW6RFLHW\SS ... a Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH 44016, USA Department of Industrial and Manufacturing Engineering, Pennsylvania State... Result integration Processor Result Result Result n Processor Processor Processor n Disk Disk m Final result Mapreduce Hypervisor Disk Data allocation Remote data upload Key Value Data source... VWUXFWXUH RI FORXGEDVHG SURJQRVLV LV VKRZQLQ)LJ )LJ,QIUDVWUXFWXUHRIFORXGEDVHGSURJQRVLV Data streaming and parallel computing 7KH VXSSRUWLQJ WHFKQLTXHV IRU FORXG PDQXIDFWXULQJ