Nghiên cứu ứng dụng FPGA thực hiện thuật toán watermarking miền DCT cho ảnh số

bộ giáo dục đào tạo trờng đại học bách khoa hà nội Đặng văn hiếu đặng văn hiếu ngành điện tử viễn thông NGHIÊN Cứu, ứng dụng FPGA thực thuật toán watermarking miền dct cho ảnh số luận văn thạc sĩ khoa học khoá 2007-2009 Hà Nội 2009 I LI GII THIU Trong nhng nm gn õy, nhu cu v an ninh giỏm sỏt bng hỡnh nh ang phỏt trin mnh m Cỏc h thng camera an ninh giỏm sỏt c trin khai rng khp l cụng c t lc khụng ch cho cỏc c quan on th m cho c cỏc cỏ nhõn qun lý, giỏm sỏt nhiu lnh vc khỏc nh qun lý giỏm sỏt giao thụng, giỏm sỏt an ninh, ti sn, thit b vt t,Nhng mt t l hỡnh nh t cỏc camera ny cú c coi l bng chng hp phỏp trung thc a trc phỏp lut Nh chỳng ta bit, vi s phỏt trin ca cụng ngh mỏy tớnh s, cỏc cụng ngh x lý hỡnh nh, vic chnh sa cỏc hỡnh nh l rt d dng v trc tip Nú cú th phỏ ri, gõy nhiu hỡnh nh cng nh thay i ni dung m khụng h li mt du vt no Vỡ vy m cỏc c quan phỏp lut, tũa ỏn gp rt nhiu khú khn xỏc thc, v coi nhng bng chng ny l loi bng chng khụng ỏng tin cy, xp chỳng vi s u tiờn thp khc phc thỡ watermarking l mt la chn tt cho ny Mc ớch ca lun l nghiờn cu ng dng cụng ngh mch tớch hp logic kh trỡnh FPGA thc hin mt thut toỏn watermarking mnh DCT cho nh s nộn JPEG Trc tiờn, cỏc thut toỏn nộn nh JPEG v watermarking DCT nộn cng nh cha nộn c phõn tớch c th T ú tin hnh xõy dng cỏc module thut toỏn s dng ngụn ng mụ t phn cng VHDL v thc hin trờn FPGA Cỏc kt qu t c cho thy kh nng ng dng rt ln ca ca mụ hỡnh thut toỏn vo thc t Tỏc gi xin chõn thnh cỏm n TS Phm Ngc Nam, B mụn K thut in t tin hc, Khoa in t vin thụng, ó tn tỡnh hng dn, trao i nhng kinh nghim v nhng ý kin quý bỏu Xin gi li cỏm n ti cỏc Thy, Cụ Khoa II in t vin thụng, ti gia ỡnh, bn bố ó giỳp v to iu kin tỏc gi cú th hon thnh lun v khúa hc Trong quỏ trỡnh thc hin, lun khụng trỏnh nhng thiu sút, tỏc gi rt mong nhn c s gúp ý ca Thy, Cụ v ng nghip H Ni, ngy 23 thỏng 10 nm 2009 Tỏc gi III MC LC LI GII THIU I TểM TT III MC LC V DANH MC CC Kí HIU, THUT NG VIT TT IX DANH MC CC HèNH V, TH X DANH MC CC BNG XIII CHNG 1: M U 1.1 C s nghiờn cu v mc ớch ca lun 1.2 T chc lun CHNG 2: TNG QUAN V CC CHUN NẫN MULTIMEIDA, WATERMARKING V CC PHNG PHP Mễ PHNG 2.1 Tng quan v nộn d liu Multimedia 2.1.1 Tng quan v multimedia 2.1.2 Hiu qu nộn d liu multimedia 2.1.2.1 T l nộn v s bit trờn mt mu 2.1.2.2 Cỏc thc o cht lng 2.1.2.3 Tr mó húa 10 2.1.2.4 phc mó húa 10 2.1.3 Tng quan v nộn nh 10 2.1.4 Cỏc tiờu chun nộn d liu multimedia 12 2.1.4.1 Chun mó húa nh tnh 12 2.1.4.2 Cỏc chun mó húa video 12 2.1.4.3 Chun mó húa audio 14 2.2 Watermarking 14 IV 2.3 Thc hin phỏt trin trờn Matlab/Simulink v FPGA 15 2.3.1 Cỏc cụng vic cn thc hin 15 2.3.2 Gii thiu cỏc cụng c ca Xilinx 16 CHNG 3: C S Lí THUYT CA CC K THUT NẫN NH JPEG V WATERMARKING CHO NH S 18 3.1 K Thut nộn nh s JPEG 18 3.1.1 Chuyn i khụng gian mu v tc ly mu mu 20 3.1.1.1 Khụng gian mu RGB 20 3.1.1.2 Khụng gian mu YCbCr 20 3.1.1.3 Tc ly mu mu 21 3.1.1.4 Macroblock 22 3.1.2 Bin i Cosin ri rc (DCT) 22 3.1.2.1 Bin i Fourier 22 3.1.2.2 Bin i cosine ri rc (DCT) 24 3.1.3 Lng t húa cỏc h s DCT 29 3.1.4 Quột zigzag cỏc h s DCT 31 3.1.5 Mó húa Entropy 32 3.1.5.1 Mó húa cú di bin i 33 3.1.5.2 Mó húa Huffman 33 3.2 Watermarking 36 3.2.1 Watermarking ti khụng gian 36 3.2.2 Watermarking ti DCT 36 3.2.3 Watermarking hin v watermarking n 38 3.2.4 Mt s ng dng ca watermarking nh s 39 3.2.5 Cỏc c tớnh mong mun cho watermark 42 V 3.2.5.1 Cỏc c tớnh mong mun cho watermark hin 42 3.2.5.2 Cỏc c tớnh mong mun cho watermark n yu 43 3.2.5.3 Cỏc c tớnh mong mun cho watermark n mnh 44 CHNG 4: PHN TCH V XY DNG CC KHI THUT TON NẫN NH V WATERMARKING 45 4.1 Cỏc thut toỏn nộn nh 45 4.1.1 Khi Thut toỏn bin i khụng gian mu 45 4.1.2 Tc ly mu mu 46 4.1.2.1 Cỏc nh dng ly mu mu c bn 46 4.1.2.2 Khi chuyn i tc ly mu mu 49 4.1.3 Thut toỏn bin i cosine ri rc (DCT) 51 4.1.3.1 Tớnh toỏn v xõy dng DCT-2D 8x8 52 4.1.3.2 Tớnh toỏn v xõy dng bin i DCT 2-D 16x16 61 4.1.4 Xõy dng lng t húa 75 4.1.5 Xõy dng quột zigzag 79 4.1.6 Xõy dng mó húa Entropy 81 4.1.6.1 Khi mó húa bc chy RLE 81 4.1.6.2 Khi mó húa Huffman 83 4.1.7 Tng hp nộn nh JPEG 84 4.2 Cỏc thut toỏn Watermarking 86 4.2.1 Xõy dng thut toỏn Watermarking-JPEG nộn 86 4.2.2 Xõy dng thut toỏn Watermarking-JPEG cha nộn 90 CHNG 5: KT QU Mễ PHNG V THC HIN PHT TRIN 96 5.1 Mụ hỡnh mc h thng vi MATLAB/SIMULINK 96 5.1.1 Phng phỏp mụ hỡnh húa mc h thng 96 VI 5.1.2 Mụ hỡnh h thng watermarking cha nộn 97 5.1.3 Mụ hỡnh h thng watermarking nộn 102 5.2 Mụ hỡnh h thng vi VHDL v thc hin trờn FPGA 106 5.2.1 Kt qu thc hin cỏc thut toỏn nộn nh JPEG 107 5.2.1.1 Khi thut toỏn bin i khụng gian mu RGB-YCrCb 107 5.2.1.2 Khi bin i tc ly mu mu 109 5.2.1.3 Khi thc hin bin i DCT_2D 8x8 111 5.2.1.4 Khi lng t húa 113 5.2.1.5 Khi quột zigzag 115 5.2.1.6 Khi mó húa bc chy RLE 117 5.2.1.7 Khi mó húa Huffman 119 5.2.1.8 Khi nộn nh JPEG tng 121 5.2.2 Kt qu thc hin cỏc thut toỏn Watermarking-JPEG 123 5.2.2.1 Khi thc hin bin i DCT_2D 16x16 123 5.2.2.2 Khi thc hin thut toỏn nhỳng watermark nộn 125 5.2.2.3 Khi Watermarking-JPEG nộn tng th 128 5.3 ỏnh giỏ v tho lun 130 5.3.1 Cht lng nh v cht lng nộn mụ hỡnh nộn nh v watermarking 130 5.3.2 ỏnh giỏ phõn tớch v thi gian, tc thc hin v chim dng ti nguyờn thc hin h thng thut toỏn trờn FPGA 134 KT LUN V HNG PHT TRIN 138 TI LIU THAM KHO 140 VII DANH MC CC Kí HIU, THUT NG VIT TT ACC DSP DCT FDCT FIFO FPGA JPEG IC IDCT Advanced Audio Coding Digital Signal Processor Discrete Cosine Transform Fast Discrete Cosine Transform First In First Out Field Programmable Gate Array Joint Picture Expert Group Integrated Circuit Inverse Discrete Cosine Transform ISO International Standard Organization ITU International Telecommunication Union IP Intellectual Property HVS Human Vision System LSB Least Significant Bit MSB Most Significant Bit MIPs Million of instructions per second MOPs Million of Operations per second MOS Mean Observer Score MPEG Motion Picture Expert Group MP3 Mpeg-1 Layer PSNR Peak Signal per Noise Ratio PC Personal Computer RLE Run Length Encode SNR Signal per Noise Ratio VCR Video Cassette Recorder VHDL VHSIC Hardware Description Language VLC Variable Length Coding Mó húa audio tiờn tin B x lý tớn hiu s Bin i cosine ri rc Bin i cosine ri rc nhanh B m vo trc trc Mng cng logic cú th lp trỡnh ti ch Nhúm chuyờn gia nh tnh Mch tớch hp Bin i cosine ri rc ngc T chc tiờu chun quc t Liờn minh vi thụng quc t S hu trớ tu H thng th giỏc ngi Bit mang ớt ý ngha thụng tin nht Bit mang nhiu ý ngha thụng tin nht Triu lnh trờn mt giõy Triu thao tỏc trờn giõy im ngi quan sỏt trung bỡnh Nhúm chuyờn gia v nh ng Chun nộn audio MPEG-1 layer T s tớn hiu trờn nhiu nh Mỏy tớnh cỏ nhõn Mó húa bc chy T s tớn hiu trờn nhiu B ghi video bng a t Ngụn ng mụ t phn cng Mó húa vi t mó bin i VIII DANH MC CC HèNH V Hỡnh 3.1: Mt mụ hỡnh nộn nh tng quỏt 11 Hỡnh 3.1: Baseline JPEG: (a) nộn, (b) gii nộn 19 Hỡnh 3.2: 4:2:0 macroblock 22 Hỡnh 3.3: Dng súng tớn hiu chn v l 24 Hỡnh 3.4: Xõy dng cỏc tớn hiu vi bin i cosine v sine 25 Hỡnh 3.5: Bin i DCT chiu 8x8 thụng qua bin i DCT mt chiu 1x8 27 Hỡnh 3.6: so sỏnh cỏc ma trn trc v sau DCT 29 Hỡnh 3.7: Quột zigzag ma trn h s DCT 32 Hỡnh 3.8 : Cõy mó Huffman cho mó húa Huffman 35 Hỡnh 3.9: Nhỳng mt watermark tn s gia 37 Hỡnh 3.10: Nhỳng watermark ti ma trn cỏc h s 16x16 38 Hỡnh 3.11: Watermarking cha nộn v nộn 39 Hỡnh 4.1: Khi thut toỏn RGB to YCbCr 45 Hỡnh 4.2: Biu din chun ly mu 4:4:4 47 Hỡnh 4.3: Qỳa trỡnh to dnh dng 4:4:4 47 Hỡnh 4.4: Biu din chun 4:2:2 48 Hỡnh 4.5: To nh dng 4:2:2 48 Hỡnh 4.6: Biu din nh dng 4:2:0 48 Hỡnh 4.7: S to nh dng 4:2:0 49 Hỡnh 4.8: Khi chuyn i 4:4:4to4:2:0 50 Hỡnh 4.9: cu hỡnh h s 4:4:4to4:2:0 50 Hỡnh 4.10: Cu trỳc ng d liu 2-D DCT 53 Hỡnh 4.11: S thc hin DCT 1-D (k: 0-7) 56 Hỡnh 4.12: S thc hin DCT 2-D (K: -> 7) 59 IX Hỡnh 4.13: Biu dũng thut toỏn 2-D DCT 60 Hỡnh 4.14: Khi thc hin thut toỏn DCT-2D 8x8 60 Hỡnh 4.15: Cu trỳc ng d liu 2-D DCT 16x16 62 Hỡnh 4.16: S thc hin DCT-1D 16x16 65 Hỡnh 4.17: S thc hin bin i DCT-2D 16x16 72 Hỡnh 4.18: Biu dũng thut toỏn 2-D DCT 16x16 73 Hỡnh 4.19: Khi thc hin DCT-2D 16x16 74 Hỡnh 4.20: Khi thc hin thut toỏn lng t húa 77 Hỡnh 4.21 : S nguyờn lý hot ng ca b lng t húa 78 Hỡnh 4.22 : Khi thc hin quột zigzag 79 Hỡnh 4.23 : S nguyờn lý hot ng ca quột zigzag 80 Hỡnh 4.24: Mó húa Entropy 81 Hỡnh 4.25: Khi thc hin mó húa bc chy RLE 82 Hỡnh 4.26: Khi thc hin mó húa Huffman 83 Hỡnh 4.27: Khi thc hin nộn nh JPEG 85 Hỡnh 4.28: Biu thut toỏn nhỳng watermark nộn JPEG 87 Hỡnh 4.29: Khi thc hin thut toỏn nhỳng watermark nộn 87 Hỡnh 4.30: Khi thc hin thut toỏn watermarking-JPEG nộn 89 Hỡnh 4.31: Biu thut toỏn nhỳng watermark cha nộn JPEG 91 Hỡnh 4.32: Khi thc hin thut toỏn nhỳng watermark cha nộn 91 Hỡnh 4.33: Khi thc hin thut toỏn watermarking-JPEG nộn 93 Hỡnh 5.1: Mụ hỡnh húa thut toỏn watermarking cha nộn 98 Hỡnh 5.2: Hai nh ngun dựng kho sỏt 99 Hỡnh 5.3: Hai nh watermark dựng kho sỏt 100 Hỡnh v 5.4: Kt qu mụ phng thut toỏn watermarking cha nộn101 127 Bng 5.19: Kt qu tng hp watermarking_block_compressed trờn dũng chip V5 jpeg_watermarking Project Status (10/15/2009 - 18:36:39) Project File: jpeg_watermarking.ise Synthesized Module Name: watermarking_block_compressed Errors: No Errors Target Device: xc5vlx50t-3ff1136 Warnings: 7812 Warnings Implementation State: Device Utilization Summary (estimated values) Logic Utilization Used [-] Available Utilization Number of Slice Registers 1122 28800 3% Number of Slice LUTs 1500 28800 5% Number of fully used LUT-FF pairs 1059 1563 67% 17 480 3% 32 3% 16 48 33% Number of bonded IOBs Number of BUFG/BUFGCTRLs Number of DSP48Es Timing Summary: Speed Grade: -3 Minimum period: 5.192ns (Maximum Frequency: 192.600MHz) Minimum input arrival time before clock: 1.844ns Maximum output required time after clock: 2.775ns Maximum combinational path delay: No path found Thc hin tng hp trờn dũng chip Spartan3E(xc3s500e-5fg320) thu c bng kt qu tng hp (Bng 5.20): Bng 5.20: Kt qu tng hp watermarking_block_compressed trờn dũng chip S3E jpeg_watermarking Project Status (10/15/2009 - 18:41:43) Project File: jpeg_watermarking.ise Module Name: watermarking_block_compressed Errors: No Errors Target Device: xc3s500e-5fg320 Warnings: 7799 Warnings Implementation State: Synthesized Device Utilization Summary (estimated values) Logic Utilization Used Available [-] Utilization 128 Number of Slices 1175 4656 25% Number of Slice Flip Flops 1090 9312 11% Number of input LUTs 1911 9312 20% Number of bonded IOBs 17 232 7% Number of MULT18X18SIOs 16 20 80% 24 4% Number of GCLKs Timing Summary: Speed Grade: -5 Minimum period: 8.869ns (Maximum Frequency: 112.748MHz) Minimum input arrival time before clock: 3.227ns Maximum output required time after clock: 4.040ns Maximum combinational path delay: No path found 5.2.2.3 Khi Watermarking-JPEG nộn tng th - Gin thi gian: 129 Hỡnh 5.17: Gin thi gian thc hin jpeg_watermarking_in_compressed_domain - Kt qu thc hin tng hp: Thc hin tng hp trờn dũng chip Virtex5(xc5vlx50t-3ff1136) thu c bng kt qu tng hp (Bng 5.21): Bng 5.21: Kt qu tng hp jpeg_watermarking_in_compressed_domain trờn dũng chip V5 jpeg_watermarking Project Status (10/15/2009 - 19:31:05) Project File: jpeg_watermarking.ise Module Name: jpeg_watermarking_in_compressed_doma in Target Device: xc5vlx50t-3ff1136 Synthesized Implementation State: No Errors Errors: 10504 Warnings Warnings: Device Utilization Summary (estimated values) Logic Utilization Used [-] Available Utilization Number of Slice Registers 3788 28800 13% Number of Slice LUTs 3335 28800 11% 130 Number of fully used LUT-FF pairs Number of bonded IOBs Number of BUFG/BUFGCTRLs Number of DSP48Es 1988 5135 38% 43 480 8% 32 6% 36 48 75% Timing Summary: Speed Grade: -3 Minimum period: 8.684ns (Maximum Frequency: 115.152MHz) Minimum input arrival time before clock: 4.190ns Maximum output required time after clock: 3.537ns Maximum combinational path delay: 3.434ns Thc hin tng hp trờn dũng chip Spartan3E(xc3s500e-5fg320) thu c bng kt qu tng hp (Bng 5.22): Bng 5.22: Kt qu tng hp jpeg_watermarking_in_compressed_domain trờn dũng chip S3E jpeg_watermarking Project Status (10/15/2009 - 19:25:33) Project File: jpeg_watermarking.ise Module Name: jpeg_watermarking_in_compressed_domain Errors: Target Device: xc3s500e-5fg320 Warnings: 12391 Warnings Implementation State: Synthesized No Errors Device Utilization Summary (estimated values) Logic Utilization Used Number of Slices [-] Available 3818 Utilization 4656 82% Number of Slice Flip Flops 3776 9312 40% Number of input LUTs 5097 9312 54% Number of bonded IOBs 43 232 18% Number of MULT18X18SIOs 24 20 24 Number of GCLKs 120% 4% Timing Summary: Speed Grade: -5 Minimum period: 12.843ns (Maximum Frequency: 77.864MHz) Minimum input arrival time before clock: 9.502ns Maximum output required time after clock: 5.712ns Maximum combinational path delay: 8.372ns 5.3 ỏnh giỏ v tho lun 5.3.1 Cht lng nh v cht lng nộn cỏc mụ hỡnh nộn nh v watermarking 131 ỏnh giỏ v cht lng nh v cht lng nộn chỳng ta s dng cỏc tiờu trớ ó c trỡnh by Chng (2.1.2) Lun s tin hnh ỏnh giỏ ti mc h thng mụ phng Matlab/Simulink Tin hnh thc hin mụ phng v tớnh PSNR trờn Matlab/Simulink cho cựng nh ngun (vanmieu.bmp) v nh watermark (DHBK.TIF) trờn mụ hỡnh khỏc nhau: Hỡnh 5.18a: Mụ hỡnh ch thc hin nộn nh JPEG Hỡnh 5.18b v 5.18c l hai mụ hỡnh Watermarking-JPEG cha nộn v nộn vi =ò=1 Mo hinh thuat toan nen JPEG-Baseline Image Video Viewer Anh nguon vao Anh sau ma hoa va giai ma JPEG YCbCr YCbCr vanmieu bmp Image Image Video Viewer RGB RGB bits Bo giai ma JPEG Anh nguon Bo ma hoa JPEG Y bits ratio 12.55 RGB Ty le nen R'G'B' to Y'CbCr Image Cb Bien doi khong gian mau Bo tach mau Cr I1 PSNR 38.8 I2 Y R'G 'B' to Y'CbCr Image Cb Cr Bien doi khong gian mau Bo tach mau a PSNR v mụ hỡnh thut toỏn ch nộn nh JPEG-Baseline PSNR Display 132 Thuat toan Watermarking cho anh so mien chua nen JPEG Anh khoi phuc watermark Video Viewer Image RGB W Video Viewer Image Bo gai watermarking Anh goc vanmieu bmp Image RGB YCbCr YCbCr RGB Anh nguon WM bits Bo giai ma Bo ma hoa Image bits 18 25 ratio Video Viewer RGB DHBK TIF Ty le nen Image Anh sau ma hoa va giai ma Anh watermark Y Image R'G'B' to Y'CbCr Video Viewer Image Cb Cr Bien doi khong gian mau Anh Watermark Bo tach mau I1 Y R'G'B' to Y'CbCr Image I2 Cb PSNR Cr Bien doi khong gian mau PSNR 22 22 Display Bo tach mau (b PSNR v mụ hỡnh watermarking-JPEG cha nộn) Thuat toan Watermarking cho anh so mien nen JPEG Image Video Viewer Image RGB Video Viewer W Anh goc Anh watermark sau khoi phuc Bo gai watermarking RGB vanmieu bmp YCbCr YCbCr RGB Image WM bits Anh nguon Bo giai ma bits Bo ma hoa ratio Anh sau ma hoa va giai ma RGB 12 03 DHBK TIF Image Image Video Viewer Ty le nen Anh watermark Image Y Video Viewer R'G'B' to Y'CbCr Image Cb Cr Anh Watermark Bien doi khong gian mau Bo tach mau Y R'G'B' to Y'CbCr Image Cb Cr Bien doi khong gian mau I1 PSNR 22 22 I2 PSNR Bo tach mau (c PSNR v mụ hỡnh watermarking nộn) Hỡnh 5.18: PSNR v mụ hỡnh thut toỏn mc h thng Display 133 PSNR cú th c tớnh toỏn bng cụng c sn cú ca Matlab/Simulink (Hỡnh 5.18) hoc cú th tớnh theo cụng thc (2.1) v (2.3) Trong mụ hỡnh ny lun s dng kt qu tớnh PSNR ca Matlab so sỏnh v ỏnh giỏ, v li bỡnh phng trung bỡnh cn bc hai RMSE s c tớnh t PSNR theo cụng thc (2.3) Kt qu c tng hp bng so sỏnh (Bng 5.23): Bng 5.23: Bng so sỏnh ỏnh giỏ kt qu mc h thng Loi mụ hỡnh x lý Mụ hỡnh ch nộn nh JPEG Mụ hỡnh Wartermarking-JPEG cha nộn Mụ hỡnh Watermarking-JPEG nộn PSNR 38.8(dB) 22.22(dB) 22.22(dB) RMSE 2.93 (4.67dB) 19.75 (13.47dB) 19.75 (13.47dB) T l nộn 12.55 18.25 12.08 Nhn xột: Mụ hỡnh ch nộn nh JPEG cho t l nộn t khỏ cao l 12.55 nm tiờu ca chun nộn JPEG, v cho PSNR l 38.8dB, tng ng nhiu RMSE l 4.67dB Vi nhiu RMSE =4.67dB ny thỡ h thng th giỏc ngi rt khú phỏt hin nhiu Vi hai mụ hỡnh Watermarking-JPEG cha nộn v nộn thỡ t c t l nộn khỏc nhau, nhng xem xột PSNR v nhiu RMSE thỡ hon ton ging C th, mụ hỡnh Watermarking-JPEG cha nộn t t l nộn rt cao l 18.25dB, PSNR=22.22dB, RMSE=13.47dB, mụ hỡnh 134 Watermarking-JPEG nộn t t l nộn thp l 12.08, PSNR=22.22dB, RMSE=13.47dB Vi nhiu RMSE phm vi 10dB ti 20dB thỡ cm th th giỏc rt d dng phỏt hin C hai mụ hỡnh watermarking cha nộn v nộn u cú RMSE=13.47dB, nú ỳng vi tiờu ca watermarking hin (=ò=1) Mụ hỡnh Watermarking cha nộn JPEG cho kt qu nộn cao m m bo cht lng nh sau nộn v nhỳng watermark xột c v mt ch quan v khỏch quan Nhng mụ hỡnh ny thỡ phc hn vỡ phi thc hin thờm bin i DCT ngc chiu 16x16 õy l phc v gõy tr nh hng ti tc x lý ca h thng thc hin trờn phn cng 5.3.2 ỏnh giỏ phõn tớch v thi gian, tc thc hin v chim dng ti nguyờn thc hin h thng thut toỏn trờn FPGA T cỏc bng kt qu tng hp thc hin cỏc thut toỏn trờn hai dũng chip FPGA, thc hin tng hp li ta c hai bng so sỏnh sau: Bng 5.24: Bng kt qu tng hp cho cỏc thut toỏn thc hin trờn dũng chip V5 (xc5vlx50t-3ff1136) Tờn S lng (T S lng Tn s cc l) cỏc (T l) i ghi chim LUT chim dng dng S lng (T l) IOB chim dng S lng (T l) DSP48E chim dng color_conv_cw 644.330MHz 97 (0%) 109 (0%) 49 (10%) (0%) color_resampler444to420 586.441MHz 100 (0%) 90 (0%) 42 (8%) (0%) dct8x8 192.600MHz 265 (0%) 373 (1%) 17 (3%) (8%) 135 Quant 410.689MHz (0%) 54 (0%) 30 (6%) (2%) zigzag_scan 366.757MHz 796 (2%) 346 (1%) 30 (6%) (0%) rle_en 388.629MHz 81 (0%) 76 (0%) 49 (10%) (0%) huffman_en 115.152MHz 316 (1%) 223 (0%) 52 (10%) (14%) dct16x16 192.600MHz 554 (1%) 738 (2%) 17 (3%) (16%) jpeg_encoder 115.152MHz 2909 (10%) 2186 (7%) 43 (8%) 24 (50%) watermarking_block_com pressed 192.600MHz 1122 (3%) 1500 (5%) 17 (3%) 16 (33%) 115.152MHz 3788 (13%) 3335 (11%) 43 (8%) 36 (75%) jpeg_watermarking_in_co mpressed_domain Bng 5.25: Bng kt qu tng hp cho cỏc thut toỏn thc hin trờn dũng chip S3E (xc3s500e-5fg320) S lng Tờn Tn s cc (T l) i SLICEs chim dng S lng S lng (T (T l) l) LUT IOB chim dng chim dng S lng (T l) b nhõn MULT18x 18 chim dng color_conv_cw 286.369MHz 78 (1%) 118 (1%) 49 (21%) (0%) color_resampler444to420 286.369MHz 58 (1%) 90 (0%) 42 (18%) (0%) dct8x8 112.748MHz 272 (5%) 462 (4%) 17 (7%) (20%) Quant 188.187MHz 56 (1%) 108 (1%) 30 (12%) (5%) 136 zigzag_scan 173.292MHz 682 (14%) 532 (5%) 30 (12%) rle_en 181.668MHz 56 (1%) 73 (0%) 49 (21%) huffman_en 77.864MHz 227 (4%) 300 (3%) 52 (22%) (25%) dct16x16 112.748MHz 584 (12%) 957 (10%) 17 (7%) (40%) jpeg_encoder 77.864MHz 2533 (54%) 3006 (32%) 43 (18%) 20 (100%) watermarking_block_comp ressed 112.748MHz 1175 (25%) 1911 (20%) 17 (7%) 16 (80%) jpeg_watermarking_in_co mpressed_domain 77.864MHz 3818 (82%) 5097 (54%) 43 (18%) 24 (120%) Nhn xột: Tn s cc i thc hin thut toỏn nộn jpeg v watermarking nộn (jpeg_watermarking_in_compressed_domain) trờn dũng chớp FPGA Virtex t tn s cc i l fmax = 115.152MHz Suy chu k xung nhp ti thiu s l T = 1/fmax = 1/111.152 Mhz = 8.684ns Khi jpeg_watermarking_in_compressed_domain c tng hp t cỏc color_conv_cw, color_resampler444to420, dct8x8, Quant, zigzag_scan, watermarking_block_compressed, rle_en, huffman_en, buffer_in_compress, i theo hai nhỏnh (Hỡnh 4.30) Khi x lý cỏc vộc t u vo phn t pixel bits T thi im bt u vộc t u vo cho ti thi im cú u ra, thc hin tng thi gian x lý l 412 chu k xung nhp: (13(color_conv_cw) + 7(color_resampler444to420) + 311(watermarking_block_compressed) + 66(zigzag_scan) + 2(rle_en) + 12(Huffman_en) + 1(mux32)) Nh vy thi gian x lý mt vộc t pixel 8bits thc hin trờn chớp V5 l 412*8.684 = 3577.808ns Vi nh s kớch thc 384x512 gm cú 24576 vộc t, ú tng 137 thi gian x lý cho mt nh ny l 24576*3577.808=87928209.4ns = 87.928ms Tc nộn ca ny l 11.373 khung hỡnh 384x512 trờn giõy Khi xem xột thc hin trờn dũng chớp Spartan3E, tn s cc i t c l 77.864MHz, suy chu k xung nhp ti thiu l 1/77.864 = 12.843ns T õy theo lp lun nh trờn ta cng tớnh c tng thi gian x lý cho mt nh s u vo cú kớch thc 384x512 l 24576*412*12.843 = 130039382ns = 130.0394ms Suy tc nộn l 7.69 khung hỡnh trờn giõy 138 KT LUN V HNG PHT TRIN Lun ó trỡnh by cỏc thut toỏn c bn ca chun nộn nh tnh JPEG Baseline Hai mụ hỡnh thut toỏn Watermarking DCT cha nộn v nộn JPEG cng ó c lun phõn tớch v xõy dng Vi cỏc kt qu mụ phng t c ti mc h thng s dng cụng c Matlab/Simulink ó khng nh tớnh ỳng n, chớnh xỏc v s mnh m ca cỏc mụ hỡnh thut toỏn C hai mụ hỡnh thut toỏn watermarking DCT nộn v cha nộn u cho kt qu PSNR ging phm vi tiờu trớ ca nộn nh v watermarking, nhng t l nộn thỡ khỏc Vi mụ hỡnh watermarking DCT cha nộn cho t l nộn ln hn rt nhiu so vi mụ hỡnh thut toỏn watermarking DCT nộn Tuy nhiờn, xột v phc v thut toỏn thỡ mụ hỡnh watermarking DCT cha nộn thỡ phc hn rt nhiu C watermarking n hay hin u c thc hin cỏc mụ hỡnh ny thụng qua vic iu chnh hai tham s v ò thut toỏn nhỳng watermark Cỏc kt qu mụ phng t c thc hin cỏc thut toỏn s dng ngụn ng mụ t phn cng HDL v thc hin trờn FPGA chng t rng mụ hỡnh thut toỏn hon ton ỏp ng c cỏc ng dng thi gian thc Vic xõy dng module ng dng cho cỏc camera an ninh giỏm sỏt s t giỏ tr ng dng cao, chi phớ thp vi cỏc dũng chip FPGA Lun cng t c cỏc tiờu vi mc ớch úng gúp ban u l: ắ S phõn tớch khoa hc v cỏc liờn quan n watermarking cho nh s nộn ó c thc hin 139 ắ Cỏc kt qu mụ phng mc h thng khng nh tớnh ỳng n v mnh m ca thut toỏn ắ Cỏc phõn tớch ti u thut toỏn cho vic thc hin trờn phn cng c nghiờn cu v thc hin ắ Kho sỏt ỏnh giỏ v a cỏc ng dng quan trng ca watermarking cỏc lnh vc bo v bn quyn v nhn thc s, c bit ng dng cho cỏc h thng camera giỏm sỏt v bo mt ắ Quy trỡnh thit k s v cỏc cụng c s dng thit k v mụ phng thc hin trờn FPGA ắ Mt kin trỳc h thng cho watermarking nh s trờn FPGA c nghiờn cu v phỏt trin Tuy nhiờn cỏc kt qu mi ch dng li mc nghiờn cu v mụ phng ng thit k Co-design trờn cỏc cụng c phỏt trin ca hóng Xilinx trờn mỏy tớnh PC Vi cỏc kt qu t c t lun vn, tip sau tỏc gi xin cp mt s hng phỏt trin nghiờn cu tng lai: ắ Tip tc nghiờn cu ch to module sn phm watermarking DCT cho nh s trờn FPGA v DSP ng dng thc t vo cỏc h thng camera an ninh giỏm sỏt ắ Nghiờn cu ng dng FPGA v DSP thc hin thut toỏn watermarking DCT cho video s nộn MPEG-2 v MPEG-4 ắ Nghiờn cu ng dng FPGA v DSP thc hin thut toỏn watermarking DCT cho video s nộn H264 140 TI LIU THAM KHO [1] Tinku Acharya, Ping-Sing Tsai, JPEG2000 Standard for Image Compression Concepts, Algorithms and VLSI Architectures, JOHN WILEY & SONS, 2005 [3] [2] Wei Cai, FPGA prototyping of a Watermarking algorithm for MPEG-4, UNIVERSITY OF NORTH TEXAS, 2007 [4] [3] Mohammed Ghanbari, Standard Codecs: Image Compression to Advanced Video Coding, IEEE Express, USA, 2003 [5] [4] Frank Hartung and Bernd Girod, Watermarking of Uncompressed and Compressed Video, University of Enlangen-Neremburg, Germany, 1998 [9] [5] Juan R Hernandez, Martớn Amado, Fernando Perez-Gonzalez, DCT-Domain Watermarking Techniques for Still Images: Detector Performance Analysis and a New Structure, IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL 9, NO 1, JANUARY 2000.[8] [6] S P Mohanty, K R Ramakrishnan, and M S Kanakanhalli, "An Adaptive DCT Domain Visible Watermarking Technique for Protection of Publicly Available Images", in Proceedings of the International Conference on MultimediaProcessing and Systems (ICMPS), pp.195-198, 2000.[7] [7] Saraju P Mohanty, K.R Ramakrishnan, Mohan S Kankanhalli, A DCT Domain Visible Watermarking Technique for Images, IEEE, 2003.[6] [8] Fred Mintzer, Gordon W Braudaway and Minerva M Yeung, Effective and Ineffective DigitalWatermarks, IEEE, 2006 [17] [9] Latha Pillai, Video Compression Using DCT, Xilinx Application Note: Virtex-II Series, 2002.[20] 141 [10] Latha Pillai, Quantization, Xilinx Application Note: Virtex and Virtex-II Series, 2003.[21] [11] Latha Pillai, Variable Length Coding, Xilinx Application Note: Virtex-II Series, 2005.[22] [12] Latha Pillai, Huffman Coding, Xilinx Application Note: Virtex Series, 2003.[23] [13] Alba M Sỏnchez G., Ricardo Alvarez G., Sully Sỏnchez G.; FCC and FCE BUAP, Architecture for filtering images using Xilinx System Generator, INTERNATIONAL JOURNAL of MATHEMATICS AND COMPUTERS IN SIMULATION, 2007.[16] [14] T Saidani , D Dia, W Elhamzi, M Atri and R Tourki, Hardware Cosimulation For Video Processing Using Xilinx System Generator, Proceedings of the World Congress on Engineering 2009 Vol I , CE 2009, July - 3, 2009, London, U.K [15] [15] Gabor Szedo, Color-Space Converter: RGB to YCrCb, Xilinx Application Note: Virtex-4, Virtex-II, Virtex-II Pro, Spartan-3, 2007 [18] [16] Clive Walker, Chroma Resampler, Xilinx FPGAs Application Note, 2006.[19] [17] http://www.watermarkingworld.org [10] [18] http://www.cosy.sbg.ac.at/~pmeerw/Watermarking/[11] [19] http://www.mathworks.com[12] [20] http://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio[13] [21] http://www.xilinx.com[14] ... tốt cho vấn đề Mục đích luận văn nghiên cứu ứng dụng công nghệ mạch tích hợp logic khả trình FPGA để thực thuật toán watermarking mạnh miền DCT cho ảnh số nén JPEG Trước tiên, thuật toán nén ảnh. .. vào thuật toán nhúng mà watermark giải tách xác ban đầu hay không Do đặc tính mạnh thuật toán watermarking miền DCT, đề tài lựa chọn watermarking miền DCT để nghiên cứu phát triển cho ứng dụng. .. khảo sát thực kỹ thuật watermarking miền DCT, miền nén miền chưa nén JPEG Mô hình lý thuyết thực watermarking cho ảnh số chương cho phép đạt watermarking ẩn hay thông qua điều chỉnh tham số mô hình