Software-defined networking aims to change the inflexible state networking, by breaking vertical integration, separating the network’s control logic from the underlying routers and switches, promoting (logical) centralization of network control, and introducing the ability to program the network. Consequently, SDN is an important key for resolving aforementioned difficulties.
MINISTRY OF EDUCATION AND TRAINING HANOI UNIVERSITY OF SCIENCE AND TECHNOLOGY TRAN MANH NAM CÁC PHƯƠNG PHÁP TIẾT KIỆM NĂNG LƯỢNG SỬ DỤNG CƠNG NGHỆ MẠNG ĐIỀU KHIỂN BẰNG PHẦN MỀM TRONG MƠI TRƯỜNG ĐIỆN TỐN ĐÁM MÂY SDNBASED ENERGYEFFICIENT NETWORKING IN CLOUD COMPUTING ENVIRONMENTS DOCTORAL THESIS OF TELECOMMUNICATIONS ENGINEERING HANOI 2018 MINISTRY OF EDUCATION AND TRAINING HANOI UNIVERSITY OF SCIENCE AND TECHNOLOGY TRAN MANH NAM CÁC PHƯƠNG PHÁP TIẾT KIỆM NĂNG LƯỢNG SỬ DỤNG CƠNG NGHỆ MẠNG ĐIỀU KHIỂN BẰNG PHẦN MỀM TRONG MƠI TRƯỜNG ĐIỆN TỐN ĐÁM MÂY SDNBASED ENERGYEFFICIENT NETWORKING IN CLOUD COMPUTING ENVIRONMENTS Specialization: Telecommunications Engineering Code No: 62520208 DOCTORAL THESIS OF TELECOMMUNICATIONS ENGINEERING Supervisor: Assoc.Prof. Nguyen Huu Thanh HANOI 2018 PREFACE I hereby assure that the results presented in this dissertation are my work under the guidance of my supervisor The data and results presented in the dissertation are completely honest and have not been disclosed in any previous works. The references have been fully cited and in accordance with the regulations. Tơi xin cam đoan các kết quả trình bày trong luận án là cơng trình nghiên cứu của tơi dưới sự hướng dẫn của giáo viên hướng dẫn. Các số liệu, kết quả trình bày trong luận án là hồn tồn trung thực và chưa được cơng bố trong bất kỳ cơng trình nào trước đây Các kết quả sử dụng tham khảo đều đã được trích dẫn đầy đủ theo đúng quy định Hà Nội, Ngày 19 tháng 01 năm 2018 Tác giả Trần Mạnh Nam ACKNOWLEDGEMENTS First and foremost, I would like to thank my advisor, Associate Prof. Dr. Nguyen Huu Thanh, for providing an excellent researching atmosphere, for his valuable comments, constant support and motivation. His guidance helped me in all the time and also in writing this dissertation. I could not have thought of having a better advisor and mentor for my PhD. Moreover, I would like to thank Associate Prof. Dr. Pham Ngoc Nam, Dr. Truong Thu Huong for their advices and feedbacks, also for many educational and inspiring discussions. My sincere gratitude goes to the members (present and former) of the Future Internet Lab, School of `Electronics and Telecommunications, Hanoi University of Science and Technology. Without their support and friendship it would have been difficult for me to complete my PhD studies Finally, I would like to express my deepest gratitude to my family. They are always supporting me and encouraging me with their best wishes, standing by me throughout my life Hanoi, 19th Jan 2018 CONTENTS ABBREVIATIONS APCI APEX ASIC BAU BFS CAPEX DC DCN DITG EANV EAVDC ECO FM FPGA GH HEAE HEE IaaS ICT ISP MoA MST NaaS NFV NV OLD OPEX PaaS PCS PM POD PSnEP RMDEE SaaS SDSN SN SNMP TCAM VDC VDCE VLiM VM Advanced Configuration & Power Interface Capital expenditure Application specific integrated circuits Businessasusual Breadthfirst Search Capital Expenditure Data center Data center network Distributed internet traffic generator Energyaware network virtualization Energyaware Virtual Data Center Eco sustainable Full migration Field programmable gate arrays GreenHead Heuristic Energyaware VDC Embedding Heuristic energyefficient Infrastructureasaservice Information and communication technologies Internet service provider Migrate on arrival Minimum spanning tree Networkasaservice Network function virtualization Network virtualization OpenDayLight Operating expenses Platformasaservice PowerControl System Partial migration Optimized data centers Power scaling and energyprofileaware Reducing middle node energy efficiency Softwareasaservice SoftwareDefined Substrate Network SecondNet Simple network management protocol Ternary contentaddressable memory Virtual data center Virtual data center embedding Virtual link mapping Virtual Machine VmM VNE VNoM VNR Virtual machine mapping Virtual network embedding Virtual node mapping Virtual network requests LIST OF FIGURES LIST OF TABLES INTRODUCTION Overview of Network Energy Efficiency in Cloud Computing Environments The advances in Cloud Computing services as well as Information and Communication Technologies (ICT) in the last decades have massively influenced economy and societies around the world. The Internet infrastructure and services are growing day by day and play a considerable role in all aspects including business, education as well as entertainment. In the last four years, the percentage of people using Internet witnesses an annual growth of 3.5%, from 39% world population’s percentage in Dec2013 to 51.7% in June2017 [1]. To support the demand of cloud network infrastructure and Internet services in the rapid growth of users, it is necessary for the Internet providers to have a large number of devices, complex design and architecture that have the capacity to perform increasingly number of operations for a scalability Consequently, many huge cloud infrastructures have been employed by Telcos, Internet Service Providers (ISPs) and enterprises for the exploded demand of various applications and data cloudservices such as YouTube, Dropbox, elearning, cloud office etc. To meet the requirements of these booming services all around the world, cloud network infrastructures have been built up in a very large scale, even geographically distributed data centers with a huge number of network devices and servers. In addition, the maintenance of the systems with high availability and reliability level requires a notable redundancy of devices such as routers, switches, links etc. As a result, having such a large infrastructure consumes a huge volume of energy, which leads to consequent environmental and economic issues: Environmentally, the amount of energy consumption and carbon footprint of the ITCsector is remarkable. The manufacture of ICT equipment is estimated its use and disposal account for 2% of global CO2 emissions, which is equivalent to the contributions from the aviation industry [2] The networking devices and components estimate around 37% of the total ICT carbon emission [3]; Economically, the huge consumed power leads to the costs sustained by the providers/operators to keep the network up and running at the desired service level and their need to counterbalance everincreasing cost of energy Although network energy efficiency has recently attracted much attention from communities [4], there are still many issues in realization of the energyefficient network including inflexibility and the lack of an energyaware network. The main difficulties of the network energy efficiency as well as its research motivations are shortly described as follows: Inflexible network: first, one important point the network in cloud data centers (DC) nowadays is the inflexibility issue. For changing the processing algorithm and the control plane of a network, its administrators should carefully redesign, reconfigure and migrate the network for a long time. In many cases, there is a technical challenge for an administrator to apply new approaches and evaluate their efficiency. Consequently, the flexible and programmable network is strictly necessary Secondly, there are difficulties in evaluating the energysaving levels of new energyefficient approaches in a network due to the lack of the centralized powercontrol system. This system allows administrators and developers to monitor, control and managing the working states as well as power consumption of all network devices in realtime Energyaware networking for virtualization technologies in cloud environments: cloud computing has emerged in the last few years as a promising paradigm that facilitates such new service models as InfrastructureasaService (IaaS), StorageasaService (SaaS), PlatformasaService (PaaS), NetworkasaService (NaaS) For such kinds of cloud services, virtualization techniques including network virtualization [5] [6] [7] and data center virtualization [8] [9] [10] have quickly developed and attracted much attention of research and industrial communities Currently, research in virtualization technologies mainly focuses on the resource optimization and resource provisioning approaches [8] [9]. There are very few works focusing on the energy efficiency of a network. With the benefits of flexible controlling and resource management of virtualization technologies as well as new network technologies such as Softwaredefined Networking (SDN) [11] [12] [13], researching in network energy efficiency in virtualization is an important and promising approach Additionally, the SDN technology, the emergence of new trends in networking technology, provides new way to realize and optimize network energy efficiency. Softwaredefined networking [11] aims to change the inflexible state networking, by breaking vertical integration, separating the network’s control logic from the underlying routers and switches, promoting (logical) centralization of network control, and introducing the ability to program the network. Consequently, SDN is an important key for resolving aforementioned difficulties Research Scope and Methodology a) Research Scope The scope of this research focuses on the network energy efficiency in cloud computing environments, including: (1) energy efficiency in centralized data center network; (2) energy efficiency in network virtualization; and (3) energy efficiency in data center [41] G V N T i O. ‐ B N Roteiro, "Efficient Resource Provisioning Using Virtualization Technology in Cloud Environment," International Journal of Innovative Research in Science, Engineering and Technology, vol 3, no 3, pp. 22002205, 2014, Oct. [42] Theophilus Benson, Aditya Akella and David A Maltz, "Network Traffic Characteristics of Data Centers in the Wild," in IMC 10, Melbourne, Australia., 2010. [43] Z. Q. R. M. H. G. A. V. V. Bin Wang, "A survey on data center networking for cloud computing," Computer Networks, vol. 91, p. 528–547, 2015. [44] A. M. N. T. Brian Lebiednik, "A Survey and Evaluation of Data Center Network Topologies," Distributed, Parallel, and Cluster Computing, 2016. [45] D. Kliazovich, P. Bouvry, S.U. Khan, "GreenCloud: a packetlevel simulator for energyaware cloud computing data centers," Journal of Supercomputing, vol. 62, no. 3, p. 1263–1283, 2012. [46] "Cisco Data Center Infrastructure 2.5," Design Guide, Cisco Validated Design, March 9, 2010. [47] S. K. L. Z. H. L. K. H. S. M. N. M.A. L. W. a. D. C. K. Bilal, "Quantitative Comparisons of the State of the Art Data Center Architectures," Concurrency and Computation: Practice and Experience, vol. 25, no. 12, pp. 17711783, 2013. [48] C E Leiserson, "Fattrees: universal networks for hardwareefficient supercomputing," IEEE Transactions on Computers, vol. 100, no. 10, pp. 892901, 1985. [49] M. AlFares, A. Loukissas, and A. Vahdat, "A scalable, commodity data center network architecture," ACM SIGCOMM Computer Communication Review, vol. 38, no. 4, p. 63–74, 2008. [50] Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Sengupta, S., "VL2: A Scalable and Flexible Data Center Network.," ACM SIGCOMM Computer Communication Review, vol. 39, no. 4, 2009. [51] Andreyev., A., "Introducing data center fabric, the nextgeneration facebook data center network.," Facebook, Nov 2014 [Online] Available: https://code.facebook.com/posts/360346274145943/. [Accessed Jan 2017] [52] A. Singh, J. Ong, A. Agarwal, G. Anderson, A. Armistead, R. Bannon, S. Boving, G Desai, B Felderman, P Germano et al.,, "Jupiter rising: A decade of clos topologies and centralized control in google’s datacenter network," in ACM Conference on Special Interest Group on Data Communication, 2015. [53] C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, "Dcell: a scalable and fault tolerant network structure for data centers," ACM SIGCOMM Computer Communication Review, vol. 38, no. 4, p. 75–86, 2008. [54] C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu, "Bcube: a high performance, servercentric network architecture for modular data centers," ACM SIGCOMM Computer Communication Review, vol. 39, no. 4, p. 63– 74, 2009. [55] A. Singla, C.Y. Hong, L. Popa, P. B. Godfrey, "Jellyfish: Networking data centers randomly," in The 9th USENIX Conference on Networked Systems Design and Implementation, CA, USA, 2012. [56] Trinh, L. Gyarmati and T. A., "Scafida: A scalefree network inspired data center architecture," ACM SIGCOMM Computer Communication Review, vol. 40, no. 5, pp. 412, 2010 [57] Heller, B., Seetharaman, S., Mahadevan, P., Yiakoumis, Y., Sharma, P., Banerjee, S., & McKeown, N., "ElasticTree : Saving Energy in Data Center Networks," in NSDI'10 Proceedings of the 7th USENIX conference, CA, USA, 2010. [58] Pham Ngoc, N., Nguyen Huu, T., Vu Quang, T., Tran Hoang, V., Truong Thu, H., TranGia, P., & Schwartz, C., "A new power profiling method and power scaling mechanism for energyaware NetFPGA gigabit router.," Computer Networks, vol. 78, p. 4–25, 2015. [59] Mahadevan, P., Sharma, P., Banerjee, S., & Ranganathan, P., "Energy Aware Network Operations.," in IEEE INFOCOM Workshops, 2009. [60] "NetFPGA Gigabit Card," netFPGA, 2015. [Online]. Available: http://netfpga.org/. [Accessed Dec 2016] [61] Wang, X., Yao, Y., Wang, X., Lu, K., & Cao, Q., "CARPO: Correlationaware power optimization in data center networks," in In 2012 Proceedings IEEE INFOCOM, 2012. [62] J Case, M Fedor, M Schoffstall and D J., "RFC 1157 A Simple Network Management Protocol (SNMP)," 1990 [Online] Available: https://tools.ietf.org/html/rfc1157 [63] K. W a Y.H. H YiChih Lei, "Multipath Routing in SDNbased Data Center Networks," in 2015 European Conference on Networks and Communications (EuCNC) , Paris, France, 2015. [64] D. P. Omair Fatmi, "Distributed multipath routing for data center networks based on stochastic traffic modeling," in Networking, Sensing and Control (ICNSC), Miami, FL, USA, 2014. [65] "DITG, Distributed Internet Traffic Generator," 2017 [Online] Available: http://www.grid.unina.it/software/ITG/ [66] Fabien Hermenier, Xavier Lorca, JeanMarc Menaud, Gilles Muller, Julia Lawall, "Entropy: a Consolidation Manager for Clusters," ACM SIGPLAN/SIGOPS, 2009. [67] Hiroki Shirayanagi, Hiroshi Yamada, and Kenji Kono, "Honeyguide: A VM MigrationAware Network Topology for Saving Energy Consumption in Data Center Networks," ISCC 2012 IEEE, Cappadocia, Turkey., July 2012 [68] V De Maio, R Prodan, S Benedict, G Kecskemeti, "Modelling energy consumption of network transfers and virtual machine migration, Modelling energy consumption of network transfers and virtual machine migration," Future Generation Computer Systems, vol. 56, p. 388–406, 2016. [69] Chowdhury, N.K., & Boutaba, R. et al., "Network virtualization: state of the art and research challenges," Communications Magazine, IEEE, vol. 47, no. 7, p. 20–26, 2009. [70] Kleinberg, J., "Approximation algorithms for disjoint paths problems," MIT, Massachusetts Institute of Technology, 1996 [71] R. Sherwood, G. Gibb, K. Yap, G. Appenzeller, N. McKeown, and G. Parulkar, "FlowVisor: A network virtualization layer," in OpenFlow Switch Consortium OPENFLOWTR2009, 2009. [72] Rob Sherwood, Michael Chan,Glen Gibb, Nikhil Handigol,TeYuan Huang,Peyman Kazemian, Masayoshi Kobayashi, David Underhill, KokKiong Yap, Guido Appenzeller, and Nick McKeown, "Carving Research Slices Out of Your Production Networks with OpenFlow," Newsletter ACM SIGCOMM Computer Communication, vol. 40, no. 1, 2010. [73] "Exploring networks of the future," GENI, [Online] Available: http://www.geni.net/. [Accessed Dec 2015] [74] "Applications, Linking Infrastructure and Ofelia,," OpenFlow in Europe, [Online]. Available: http://www.fp7ofelia.eu. [Accessed dec 2016] [75] "OF@TEIN OpenFlow@TransEurasian Information Network," [Online]. Available: http://oftein.net. [Accessed Dec 2016] [76] Botero, J. F., Hesselbach, X., Fischer, A., & de Meer, H., "Optimal mapping of virtual networks with hidden hops," Telecommunication Systems, vol. 51, no. 4, p. 273–282, 2013. [77] Andreas Fischer, Juan Felipe Botero, Michael Till Beck, Hermann de Meer, and Xavier Hesselbach, "Virtual Network Embedding: A Survey," IEEE COMMUNICATIONS SURVEYS & TUTORIALS, vol. 15, no. 4, 2013. [78] M Y Y R J & C M Yu, "Rethinking virtual network embedding," ACM SIGCOMM Computer Communication Review, vol. 38, no. 2, p. 17, 2008. [79] B M Waxman, "Routing of multipoint connections," IEEE J Sel Areas Communication, vol. 6, no. 9, pp. 16171622, , 1988. [80] Skiena, S. S., "The Algorithm Design Manual, 2nd Edition," Springer Pub lishing Company, 2008 [81] A. B. J. D. M. S. D. H. X. D. M. H. Fischer, "ALEVIN A framework to develop, compare, and analyze virtual network embedding algorithms," Electronic Communications of the EASST, vol. 37, pp. 112, 2011. [82] P. Costa, M. Migliavacca, P. Pietzuch, A. L. Wolf, "NaaS: NetworkasaService in the cloud," in The 2nd USENIX Workshop on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services, USENIX, San Jose, CA, USA, 2012. [83] Fischer, A., Botero, J. F., Beck, M. T., de Meer, H., Hesselbach, X., Meer, H. De, … Hesselbach, X., "Virtual network embedding: A survey," IEEE Communications Surveys and Tutorials, vol. 15, no. 4, p. 1888–1906, 2013. [84] Yoonseon Han, Jian Li, JaeYoon Chung, JaeHyoung Yoo, & Hong, J. W.K., "SAVE: Energyaware Virtual Data Center embedding and Traffic Engineering using SDN," in In Proceedings of the 2015 1st IEEE Conference on Network Softwarization (NetSoft), London, UK, 2015. [85] Guo, C., Lu, G., Wang, H. J. H. J., Yang, S., Kong, C., Sun, P., … Zhang, Y., "SecondNet: a data center network virtualization architecture with bandwidth guarantees," in Proceedings of the 6th International COnference, (VDC, Pennsylvania, USA, 2010. [86] A. Amokrane, M. F. Zhani, R. Langar, R. Boutaba, G. Pujolle, "Greenhead: Virtual data center embedding across distributed infrastructures," IEEE Transactions on Cloud Computing, vol. 1, no. 1, p. 36–49, 2013. [87] H. Goudarzi, M. PedramH. Goudarzi, M. Pedram, "Energyefficient virtual machine replication and placement in a cloud computing system," in IEEE Fifth International Conference on Cloud Computing, Honolulu, HI, USA, 2012. [88] F Farahnakian, P Liljeberg, J Plosila, "Energyefficient virtual machines consolidation in cloud data centers using reinforcement learning," in 22nd Euromicro International Conference on Parallel, Distributed, and NetworkBased Processing, Torino, Italy, 2014. [89] A. Beloglazov, R. Buyya, Y. C. Lee, A. Y. Zomaya, "A taxonomy and survey of energyefficient data centers and cloud computing systems," Advances in Computers 82 (2011) 47 – 111, pp. 47111, 2011. [90] "OpenStack," [Online]. Available: https://www.openstack.org. [Accessed Dec 2016] [91] J. H. D. A. M. P. P. A. Greenberg, "The cost of a cloud: Research problems in data center networks," ACM SIGCOMM Computer Communication Review, vol. 39, no. 1, p. 68–73, 2009. [92] A. Desai, R. Oza, P. Sharma, and B. Patel, "Hypervisor : A Survey on Concepts and Taxonomy," no. 3, vol. 3, pp. 222 225, 2013. [93] "CT503MIX HighSpeed LANforgeFIRE Traffic Generator," Candela Technology, 2017 [Online] Available: http://www.candelatech.com/ct503 MIX_product.php. [Accessed 2017] [94] A. AlShabibi, M. De Leenheer, M. Gerola, A. Koshibe, G. Parulkar, E. Sal vadori, B. Snow, "OpenVirteX: Make your virtual SDNs programmable," in Proceedings of the Third Workshop on Hot Topics in Software Defined Networking, HotSDN ’14, ACM, New York, NY, USA, 2014. [95] D Schwerdel, D Gunther, R Henjes, B Reuther, and P Muller, "Germanlab experimental facility in Future Internet," FIS 2010, ser.Lecture Notes in Computer Science SpringerVerlag Belin Heidelberg, vol. 6369, p. 1, 2010. [96] H. T. Nguyen, A. V. Vu, D. L. Nguyen, V. H. Nguyen, M. N. Tran, Q. T. Ngo, T. H. Truong, T. H. Nguyen, T. Magedanz, "A generalized resource allocation framework in support of multilayer virtual network embedding based on SDN, Computer Networks," Computer Networks, vol. 92, no. 2, pp. 251 269, 2015. [97] L Ceuppens, A Sardella, D Kharitonov, "Power Saving Strategies and Technologies in Network Equipment Opportunities and Challenges, Risk and Rewards," in Proc. Internat. Symp. on Applications and the Internet (SAINT 2008), Turku, Finland, 2008. [98] Singh, M Gupta and S., "Greening of the Internet," in ACM SIGCOMM Conf (SIGCOMM 03, Karlshue, Germany, Aug2003. [99] R D Corin, M Gerola, R Riggio, F D Pellegrini, E Salvadori, "VeRTIGO: Network virtualization and beyond," in European Workshop on Software Defined Networking, Darmstadt, Germany, 2012. [100] Mohsen, Ehab, "Reducing System Power and Cost," XILINX White Paper: Artix7 FPGAs, Sep2016 ... SDNBASED ENERGYEFFICIENT NETWORKING IN CLOUD COMPUTING ENVIRONMENTS Specialization: Telecommunications Engineering Code No: 62520208 DOCTORAL THESIS OF TELECOMMUNICATIONS ENGINEERING Supervisor: Assoc.Prof. Nguyen Huu Thanh... INTRODUCTION Overview of Network Energy Efficiency in Cloud Computing Environments The advances in Cloud Computing services as well as Information and Communication Technologies (ICT) in the last decades have massively influenced economy and societies ... system allows administrators and developers to monitor, control and managing the working states as well as power consumption of all network devices in realtime Energyaware networking for virtualization technologies in cloud environments: cloud computing has emerged in the last few years as a promising paradigm that facilitates such