Advanced content delivery, streaming, and cloud services

ADVANCED CONTENT DELIVERY, STREAMING, AND CLOUD SERVICES ADVANCED CONTENT DELIVERY, STREAMING, AND CLOUD SERVICES Edited by Mukaddim Pathan Telstra Corporation Ltd., Australia Ramesh K Sitaraman University of Massachusetts, Amherst and Akamai Technologies, USA Dom Robinson id3as-company Ltd., UK Cover Image: iStockphoto © nadla Cover Design: Wiley Copyright © 2014 by John Wiley & Sons, Inc All rights reserved Published by John Wiley & Sons, Inc., Hoboken, New Jersey Published simultaneously in Canada No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 750-4470, or on the web at www.copyright.com Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permission Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose No warranty may be created or extended by sales representatives or written sales materials The advice and strategies contained herein may not be suitable for your situation You should consult with a professional where appropriate Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages For general information on our other products and services or for technical support, please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002 Wiley also publishes its books in a variety of electronic formats Some content that appears in print may not be available in electronic formats For more information about Wiley products, visit our web site at www.wiley.com Library of Congress Cataloging-in-Publication Data: Advanced content delivery, streaming, and cloud services / editors, Mukaddim Pathan, Ramesh K Sitaraman, Dom Robinson pages cm Includes index ISBN 978-1-118-57521-5 (hardback) Cloud computing Computer networks I Pathan, Mukaddim II Sitaraman, Ramesh Kumar, 1964- III Robinson, Dom QA76.585.A377 2014 004.67′ 82–dc23 2014005235 Printed in the United States of America 10 To my wife Ziyuan for her inspiration, love, and support This book would not have been completed, if she did not single-handedly take care of everything, while I was too busy in writing and compilation!—Mukaddim To my wife Vidya for her love and support And to our lovely children Anu and Siddu for reminding me that despite our best efforts the Internet still isn’t fast enough for them!—Ramesh To my wife Mariana and our wonderful kids Sofia and Zac—I am sure you will enjoy this book as a bedtime reading And to my parents (that funny “computer thing” you bought me as a kid came in handy!)—Dom CONTENTS Preface Acknowledgments Contributors PART I CDN AND MEDIA STREAMING BASICS CLOUD-BASED CONTENT DELIVERY AND STREAMING Mukaddim Pathan 1.1 Introduction 1.2 CDN Overview 1.3 Workings of a CDN 1.4 CDN Trends 1.5 Research Issues 1.6 Conclusion References LIVE STREAMING ECOSYSTEMS Dom Robinson 2.1 Introduction 2.2 Live Streaming Pre-Evolution 2.3 Live, Linear, Nonlinear 2.4 Media Streaming 2.5 Related Network Models 2.6 Streaming Protocol Success 2.7 Platform Divergence and Codec Convergence 2.8 Adaptive Bitrate (ABR) Streaming 2.9 Internet Radio and HTTP xv xxi xxiii 3 10 21 28 29 29 33 33 34 35 37 38 43 44 45 48 viii CONTENTS 2.10 Conclusion References 48 49 PRACTICAL SYSTEMS FOR LIVE STREAMING Dom Robinson 51 3.1 3.2 3.3 3.4 51 52 56 69 70 Introduction Common Concepts in Live Streaming The Practicals Conclusion References EFFICIENCY OF CACHING AND CONTENT DELIVERY IN BROADBAND ACCESS NETWORKS Gerhard Haßlinger 4.1 Introduction 4.2 Options and Properties for Web Caching 4.3 Zipf Laws for Requests to Popular Content 4.4 Efficiency and Performance Modeling for Caches 4.5 Effect of Replacement Strategies on Cache Hit Rates 4.6 Replacement Methods Based on Request Statistics 4.7 Global CDN and P2P Overlays for Content Delivery 4.8 Summary and Conclusion Acknowledgments References ANYCAST REQUEST ROUTING FOR CONTENT DELIVERY NETWORKS Hussein A Alzoubi, Michael Rabinovich, Seungjoon Lee, Kobus Van Der Merwe, and Oliver Spatscheck 5.1 Introduction 5.2 CDN Request Routing: An Overview 5.3 A Practical Load-Aware IP Anycast CDN 5.4 Mapping Algorithms 5.5 Evaluation 5.6 IPv6 Anycast CDNs 5.7 Discussion and Open Questions 5.8 Conclusion References 71 71 73 75 76 78 81 84 86 87 87 91 91 93 96 98 102 107 114 116 116 INDEX Access network, 121–3 virtualization support, 125–9 customer VLAN, 126–7 multicast VLAN, 127 service VLAN, 126 virtualizing, 123–30, See also individual entry Adaptive bitrate (ABR) streaming, 18, 45–8, 145–6, 263, 265 Adaptive streaming, 223–4, 259–69 dynamic server deployment, 262 virtual machine migration, 262 vMatrix, 262 XenoServer, 262 flash crowds and adaptive CDNs, 260–261 mobile thread migration, 262 Adero, 330 Ad insertion, 28 Advanced Load Balancing, Always (ALB-A), 104 Advanced Research Projects Agency Network (ARPANET), 34 AgentSpace, 262 Aglets, 262 Akamai perspective, 307–26, 332, 333, 336, 338, 349, See also overlay networks ALB, On-Overload (ALB-O), 104 Alcatel-Lucent, 332 All-Pairs-Shortest-Path (APSP) algorithm, 321 America Online, 330 Analytic model, 204–5 Analytics-as-a-service (AaaS), 175 Analyzing CDNs, 203–16 basic CDN model, 205–6 communication model, 210–212 content model, 204, 208–9 performance evaluation, 212–16 redirection model, 204 Antiattack (AA) functionality, 363 Anti-DDoS protection, 363–5 Anycast gateway, 112 Anycast request routing for CDNs, 91–116, See also IPv6 anycast CDNs; mapping algorithms CDN request routing, 93–6 DNS-based request routing, 93–4 request routing using IP anycast, 94–5 load-aware IP anycast CDN, 96–8 Anycast servers, 109 Apache Traffic Server, 331–2 Application acceleration, 22–3 Application delivery controller (ADC) capabilities, 22 Application layer multicast (ALM), 386 Application Request Routing (ARR), 378 Asset- or object-based reports, 168 Asymmetric Digital Subscriber Line (ADSL), 42 Asynchronous transfer mode (ATM) network, 390 AT&T, 332, 336 Audio and video on demand (AVoD), 20 Authoritative DNS (ADNS), 92 Back-end layer, 16 BackSlash, 261 Advanced Content Delivery, Streaming, and Cloud Services, First Edition Edited by Mukaddim Pathan, Ramesh K Sitaraman, and Dom Robinson © 2014 John Wiley & Sons, Inc Published 2014 by John Wiley & Sons, Inc 466 Benders decomposition, 180–181 Benders feasibility, 194 Benders optimality, 194 Benders subproblem, 193 Billing analytics, 173–4 Binding update (BU), 108 BitTorrent, 331–2, 338, 340, 342–3, 346 Blocksize, 224 Bootstrap, 227 British Telecom, 335 Broadband access networks, 71–87 caching and content delivery, 71–87, See also caches; Web caching; Zipf laws Broadband service appliances, thin-client, 130–133 Broadcast using this tool (BUTT), 57–9 server settings for the test, 59 settings interface, 59 user interface, 57–9 Broadcasting, 183 Buffer management, 144 Business intelligence (BI) platforms, 169–71 BUTT Encoder, 57 Buzztraq, 458 Byte reduction, 22, 24 Cache hierarchy, 315–17 Cache hit rates, 78–81 dynamic popularity influence, 83 LRU hit rates for measured traces of YouTube video requests, 79–81 replacement strategies effect, 78–81 worst-case LRU deficits for web caches with static popularity, 78–9 Cache replacement strategies, 77, 81–2 Cache storage, 386–7, 389, 390–391, 394, 396 CacheCast, 385–409 CacheCast server support, 394 caching-aware source, 391–2 detailed link cache operation, 392–3 Cache hit, 393 Cache miss, 393 IP multicast, 386 link cache size, 394–6 placement of cache elements, 391 CacheLogic, 332 Caches, 76–8, See also Web caching efficiency and performance modeling, 76–8 INDEX Caching overlays, 309, 314–18 origin offload benefits, 315–18 cache hierarchy, 316 dealing with unpopular content, 317–18 performance benefits, 315 Caching, 206, 385–410 caching policy, 216 Capacity planning, 289–303 Capacity requirements, 297 Capital expense (CAPEX), 74 Capital management, 291, 294, 296–7, 300 Capital position cycle, 299 Carrier CDNs, 331–2 Carrier/Telco CDN, Cascaded-pixel transoder, 147 CDN analytics, 161–76 billing analytics, 173–4 95/5 or the 95th percentile, 173–4 metered bandwidth, 174 metered processor time, 174 business intelligence (BI) platforms, 169–71 delivery optimization, 166–8 dynamic bandwidth allocation and pricing, 167–8 elastic load balancer (ELB), 166 load balancing, 166 external reporting, 168–9 asset- or object-based reports, 168 customer-based reports, 168 delivery appliance reports, 169 geography-based reports, 169 internal assessment, 162–8 asset issues, 163 geographic-regional (geo-regional) issues, 164–5 PoP issues, 165 quality of service, 163 troubleshooting, 163 stateless delivery, 171–3 CDN Interconnection (CDNI), 335 CDN modeling, 179–200 mathematical modeling and optimization, 180–182 Benders decomposition, 180–181 integer linear program (ILP), 180 Lagrangean relaxation, 181–2 video-on-demand applications, 182–4 CDN simulator, 204 INDEX CDN software companies, 336 CDN with dynamic delegation, 260 CDNsim, 204 CellMux, 55 Cellular Multiplexer (CellMux), 54 China, content delivery in, 353–67 content-aware network services (CANS) in China, 356–65 anti-DDoS protection, 363–5 Intelligent Traffic Reduction (ITR), 360 Interactive Content Acceleration (ICA), 358–60 Transparent Transport Acceleration (TTA), 358–60 end-user connectivity in China, 355 mobile explosion, 355–6 Web hosting, 355 ChinaCache perspective, 353–67 Cisco, 330, 332, 335 Classic live streaming workflow, 35 Client-layer solution, 261 Clients, 277 Client-side scripting, 14–15 Closed-loop transcoder, 147 Cloud-based content delivery and streaming, 3–29, 246–7, See also content delivery networks (CDNs) Cloud-based content delivery to home ecosystems, 119–37, See also under home ecosystems Cloud-based multi-source streaming, 220–221, 224, 232, 237 Cloud-based streaming, 151–4, 232, 237 mobile video streaming service, 151–3 SVC-based mobile cloud streaming, 153–4 Cloud computing, 119, 243–4, 248, 251–2, 255, 276 Cloud from periphery to edge, 251–2 Cloud provider, 222 Cloud streaming model, 231 Cluster concept, 206 CoBlitz, 329–49, See also next-generation CDNs Codec convergence, 44–5 Comcast, 332 Communication model, 210–212 Computer architecture, 388 Computing at the edge, 251 Congestion, 310, 321 467 Connection-oriented communication, lightweight IPv6 anycast for, 109–11 Constant bitrate (CBR) video, 221 Content alliance, 330 Content-aware network services (CANS) in China, 356–65, See also under China Content-blind caching, 16 Content bridge, 330 Content broadcast, 431–47 Content containers, 408 Content delivery, 353–66 global CDN, 84–6 P2P overlays, 84–6 Content delivery networks (CDNs), 35, 48, 72–4, 179–200, 203–16, 243–57, 273–86, 449, See also analyzing CDNs; anycast request routing for CDNs; capacity planning, CDN; CDN analytics; CDN modeling; dynamic content delivery; HTTPS content delivery; mining distributed data streams on CDNs abstract view, carrier/Telco CDN, federated CDN, functional attributes, 12 licensed CDN, managed CDN, market and product segments, 6–10 banking, 10 consumer products/retail, e-commerce, entertainment, financial services, 10 hospitality, insurance, 10 leisure, media, public sector/government and enterprise, 10 travel, market drivers and impacts, peripheral value-added services, 27–8 positioning in a representative video ecosystem, 11 product portfolio of, pure-play CDN, static content delivery, 13–14 transparent caching convergence with, 26–7 trends, 21–8 468 Content delivery networks (CDNs) (Continued) types, video ecosystem and, 10 Content delivery virtualization, 227–8 Content edge networking (CEN), 204 Content model, 204, 208–9 Content processing at the edge of the cloud, 243–57, See also edge cloud-based model enhanced security and billing, 256 existing content delivery platforms, 244–7 interactive content delivery, 255 local content access, 256 simple user device, 256 unbounded resources, 255 Content-processing-as-a-service (CPaaS), 253 Content provider media streaming for DLNA devices, 133–5 Content replication, 16, 28 Contextual analysis and streaming, 155 Controlled buffering, 144 Cooperative caching, 183 Cooperative online replacement algorithms, 421–3 CoopNet, 261 CoralCDN, 261 CPE WAN Management Protocol (CWMP), 121 Cross-layer optimization, 155 Curve aggregates, 234 Curve diff, 234, 235 Customer-based reports, 168 Customer satisfaction indices, 175 Customer VLAN, 126 Data-centered services, 183 Data deduplication, 361 Data redundancy elimination (DRE), 361 Datagram Congestion Control Protocol (DCCP), 399 Decoder, 38 Dedicated short-range communication (DSRC), 433 Deep packet inspection (DPI), 147, 150–151 Delivery appliance reports, 169 Demand cycle, 299 Democratization, 250 Denial of service, 363 Deployment, 290, 292, 294, 297 INDEX Desktop-as-a-Service (DaaS) applications, stateless thin-clients, 131 Deutsche Telekom, 336 Diffusion of information, 451 Digital Living Network Alliance (DLNA), 375, 379–81 content provider media streaming for, 133–5 DLNA Media Renderer (DMR), 375 Digital video recorder (DVR), 20 Direct path, 319 Distributed data stream, 273–86 Distributed denial-of-service (DDoS) attacks, 363–5 Distributed hash tables (DHTs), 276 Distributed processing, 385 Distributed replication groups (DRGs), 415 Distributed selfish replication (DSR) game, 415 Distribution networks, 42–43 Domain Name System (DNS), 92, 359, 363–4 authoritative DNS (ADNS), 92 local DNS (LDNS), 92 DotSlash, 260 Double tagging, 127 Dynamic adaptive streaming over HTTP (DASH), 146, 247 Dynamic bandwidth allocation, 167–8 Dynamic content delivery, 8, 14–16 application layer, 14 back-end layer, 16 front-end layer, 14 logical layers of a Web system for, 15 user profile layer, 16 Dynamic resilient streaming, 268 Dynamic server deployment, 262 Dynamic streaming policies, 183–4 Edge cache, 26 EdgeCast, 336 Edge cloud-based model, 251–5, See also content processing at the edge of the cloud architecture, 254–5 content processing, 255 interactive content, 255 local demand-only content, 255 peering of edge cloud, 255 redirection, 255 replica/cache, 254 469 INDEX service and content replication, 255 benefits of introducing the edge cloud, 252–3 cloud from periphery to edge, 251–2 computing at the edge, 251 content processing, 253–4 remote cloud, 251 EdgeComputing, 251 Edge hit rate, 315 Edge servers (ESs), 313 Edge traffic, 317 Elastic load balancer (ELB), 166 Electronic Program Guide (EPG), 10, 35 Encoder, 38 EnCOding and DECoding (CODEC), 44 End-user connectivity in China, 355 Entertainment, Ethernet Passive Optical Networks (EPONs), 123 European Telecommunications Standards Institute (ETSI), 433 Evolved packet core (EPC), 142 External reporting, 162, 168–9 Extract–transform–load (ETL), 170 False acceptance rate (FAR), 363 False rejection rate (FRR), 363 Faster page rendering, 22, 25 Federated CDNs, 7, 331, 333–5 higher utilization of managed CDN, 334 off-network access to content, 333 regional CDN exchange, 334 Fiber-to-the-Home (FTTH), 130 File Delivery over Unidirectional Transport (FLUTE) protocol, 432 File Transfer Protocol (FTP) server, 401 File transfer time, 437–9 Fixed networks, 85–6 Flash crowds, 260–261, 264–5, 267 and adaptive CDNs, 260–261 adaptive streaming on, 263 client-layer solution, 261 intermediate-layer solution, 261 server-layer solution, 260 Flash Crowds Alleviation Network (FCAN), 260, 261 Flash media live encoder, 62 live video, 62–6 Forward error correction (FEC), 432–4 Fragment-based technique, 14 France Telecom, 332 Freeze time, 222, 232 Frequent items, 274–86 Front-end layer, 14 Front-end optimization (FEO), 7, 22–5 Generalized assignment problem (GAP) rounding techniques, 321 Generic service model, 229 Geodiversity, 453 Geography-based reports, 169 Georange, 453 Global CDN for content delivery, 84–6 Google Global Cache, 337 GPRS support node (GGSN), 142 3G radio access network (RAN), 142 Greedy buffering, 144 HD content, 369, 373 Hierarchical CDN model, 207 Hierarchical mobile CDN, 150 High definition multimedia interface (HDMI), 53–5 Highest Random Weight (HRW), 340 Highwinds, 333 Hit rate analysis, 79 Holistic online replacement algorithms, 421–3 Home ecosystems, cloud-based content delivery to, 119–37 access network, 121–3 future trends, 137 home device and service ecosystem, 120–121 home LAN, 121–3 RGWs, 121–3 state of the art, 120–123 virtualization, 130–136 Home LANs, 120–124, 128 Home network, 380 HTML5, 52, 56–7, 60–63, 66, 70 Hybrid multidomain architecture, 277–80 Hybrid of P2P and CDN, 245–6 HyperText Transfer Protocol (HTTP), 48, 72, 92–3, 102, 114 HTTP adaptive streaming, implications of, 345–7 470 HyperText Transfer Protocol (HTTP) (Continued) HTTP live streaming (HLS), 62, 263 HTTPS content delivery, 16–18 Industry directions, CDN, 348–9 Information-centric networks (ICN), 413–26 content replication and delivery in, 413–26 related work, 414–16 framework for information replication in ICN, 416–23 cooperative class, 421–3 holistic class, 421 modified greedy algorithm, 417–19 offline assignment phase, 417–19 online replacement phase, 419–23 planning and offline replica assignment algorithm for ICNs, 419 planning phase, 416–17 performance evaluation, 423–6 Information diffusion, 451 Infotainment, 431–3 Inktomi, 330, 332, 335 Inktomi Traffic Director, 331 Integer linear program (ILP), 180 Integrated receiver decoder (IRD), 53 Intelligent request routing (IRR), 166–7 Intelligent Traffic Reduction (ITR), 360 Intelligent transportation systems (ITS), 432 Interactive content, 255 Interactive Content Acceleration (ICA), 358–60 Intermediate-layer solution, 261 Internal assessment, 162–8, See also under CDN analytics Internal reporting, 162–8 Internet Engineering Task Force (IETF), 75, 358 Internet Layer, 39–40 Internet Pay TV (IPTV), 5, 21 Internet radio, 48 Internet service providers’ (ISPs’), Internet traffic, 71–2, 74, 84 IP anycasting, 29 IP multicast, 52, 66–9, 386 IPv6 anycast CDNs, 107–14 architecture, 112–14 IPv6 mobility (MIPv6) overview, 107–8 INDEX lightweight IPv6 anycast for connection-oriented communication, 109–11 TCP interaction, 110 using MIPv6 for CDN request routing, 108–9 JavaGo, 262 Jet-Stream, 336 k-median problem, 415 Kolmogorov–Smirnov test (kstest), 234 Korea Telecom, 335 Lagrangean relaxation, 181–2 Least frequently used (LFU) replacement strategy, 77 Least recently used (LRU) replacement strategy, 78 worst-case LRU deficits for web caches with static popularity, 78–9 Lexicographic maximin optimization problem, 189 Licensed CDNs, 7, 329, 331, 335–7 Lightweight IPv6 anycast for connection-oriented communication, 109–11 Limelight, 333 Linear streaming, Linear video, 35–6 Link Aggregation Control Protocol (LACP), 381 Live sources, 277 Live streaming, 8, 18–20, 33–49, 51–70 concepts in, 52–6 pre-evolution, 34–5 Live streaming ecosystems, 33–49, See also adaptive bitrate (ABR) streaming; practical systems for live streaming classic live streaming workflow, 35 codec convergence, 44–5 HTTP, 48 internet radio, 48 live, linear, nonlinear, 35–6 media streaming, 37–8 platform divergence, 44–5 related network models, 38–43 applications—transport protocols, 40 contribution feeds, layers and 2, 41–2 INDEX distribution networks considerations, 42–3 internet layer considerations, 39–40 physical network considerations, 39 transport layer considerations, 40–42 streaming protocol success, 43–4 Load-aware IP anycast CDN, 96–8 architecture, 97 benefits, 98 limitations, 98 Load balancing, 94, 99, 106, 166 Local demand-only content, 255 Local DNS (LDNS), 92 Long-term evolution (LTE), 141 Macroscopic approaches for social cascades characterization, 455–6 Managed CDNs, 7, 331–3, 336 Mapping algorithms, 98–102 minimum cost algorithm, 99–100 minimum disruption algorithm, 101–2 problem formulation, 99 Mapping system, 313 Measurement, 161–2, 168–9, 171, 173 Media, Media diffusion, 452, 456–8 Media streaming, 37–8, 148 Metered bandwidth, 174 Metered processor time, 174 Microscopic approaches for social cascades characterization, 454–5 Midgress traffic, 317 Mining distributed data streams on CDNs, 273–86 background, 275–7 hybrid multidomain architecture, 277–80 architecture, 277 prototype for, 281–5 related work, 275–7 Mixed integer program (MIP), 321 MOBA, 262 Mobile agent, 262 Mobile content acceleration, 23–6 Mobile content delivery, 23–6 Mobile networks, caching in, 85–6 Mobile thread migration, 262 Mobile video cloud controller (MVCC), 151–3 471 Mobile video cloud optimizers (MVCO), 151–3 processing delay, improving approaches, 152 content servers, 153 local cache, 153 parallel transcoding/transrating technique, 152 Mobile video streaming, 141–55, See also cloud-based video streaming; video streaming protocols future research directions, 154–5 contextual analysis and streaming, 155 cross-layer optimization, 155 multimedia broadcast multicast service (MBMS), 155 power-aware video streaming, 155 streaming over heterogeneous networks, 155 mobile broadband architecture, 142–3 3G network, 143 LTE network, 143 mobile CDN use case deployment, 150–151 network adaptation, 148 media streaming functions, 148 transcoder inputs, 148 operator-hosted CDN, 149–51 video optimization services, 146–7 video optimizer deployment, 149 video transcoding, 147 Mobility management entity (MME), 142 Modified greedy algorithm, 417–19 Multicast, 385–7, 389, 397–8, 407 Multicast VLAN, 127 Multidestination traffic, 389–91 Multi-Level Caching, 261 Multimedia, 432, 434, 446 Multimedia Broadcast Multicast Service (MBMS), 155 Multimedia service, 370, 378, 382–3 Multiprotocol Label Switching (MPLS) tunnels, 97, 128 Multisource stream aggregation in the cloud, 219–39 adaptive streaming, 223–4 analysis, 231–6 by curve aggregates, 234 federated performance measurement, 238 472 Multisource stream aggregation in the cloud (Continued) overall performance, 233–4 performance in realistic conditions, 234–6 background, 222–4 congestion problem, 220, 223 models, 228–31 cloud streaming model, 231 generic service model, 229 P2P streaming model, 231 service in the network graph, 229 throughput model, 229–31 traditional streaming model, 231 P2P streaming, 224 related work, 222–4 stream aggregation in the cloud, 226–8 client-side optimization, 228 content delivery virtualization, 227–8 VM populations, optimization, 228 substream method in the cloud, 224–6 terminologies, 221–2 throughput reliability problem, 220, 223 traditional streaming, 223 Multi-stream content aggregation, 219–39, See also multisource stream aggregation in the cloud Natural Address Translation (NAT), 41 Net promoter score (NPS), 175 Network Address Translation (NAT) configuration, 120, 143 Network Bootstrap Program (NBP), 130 Network PVR, 28 Network simulation, 436 Network Voice Protocol (NVP), 34 Network Voice Protocol (NVP-II), 34 Networking/content-centric networking (NDN/CCN), 415 Next-generation CDNs, 329–49 carrier CDNs, 331–2 CoBlitz case study, 337–43 CoBlitz commercialization, 343–5 HTTP adaptive streaming, 345–7 CoBlitz commercialization lessons, 347–8 federated CDNs, 333–5 licensed CDNs, 335–7 managed CDNs, 332–3 Non-linear video, 35–6 INDEX Novell, 332 N-play, 121–2 NS-2, 204 NS-3, 432, 436–7 Object placement, 185, 188–9 Off-line replica assignment, 419 OMNeT++, 204 On-demand streaming, 20–21 Online applications, 308 Online replacement phase, 419–23 cooperative class, 421–3 holistic class, 421 Online social networks (OSNs) impact in content delivery, 449–61 background, 450–452 future research directions, 459–61 measurements, 456–8 OSN media diffusion, 457–8 OSN usage analysis, 456–7 media diffusion, 452 social cascades, characterization of, 453–6 approaches, 454–6 geographical properties, 453 macroscopic approaches, 455–6 microscopic approaches, 454–5 rate of the cascade, 454 structural properties, 453–4 temporal properties, 453–4 time delay, 454 time duration, 454 usage analysis, 452 On-the-fly transcoding, 27 Open cloud, 236–7 Open-loop transcoder, 147 OpenCourseWare, 371–2 Open Shortest Path First (OSPF) dynamic routing protocol, 381 Open Systems Interconnection (OSI), 38 Operational expense (OPEX), 74 Operator-hosted CDN, 149–51, 330, 337 CDN as part of mobile packet core network, 149 CDN as part of radio access network, 150 hierarchical mobile CDN, 150 mobile CDN use case deployment, 150–151 Optimization problems, 142, 147–8, 151–3, 155, 185–98 INDEX in content delivery and VoD services, 185–98 CDN pricing, 195–8 lexicographic maximin optimization problem, 189 object placement, 185 proxy server location and object placement, 188–9 proxy server location problem, 185 request routing, 185 resource management and allocation in CDNs, 185 Origin offload benefits, 309, 315–18 Origin server, 6, 16, 18, 20, 184–6, 191–3, 314 Origin storage, 28–9 Origin traffic, 317 Overall response time, 216 Overcapacity requests, 103 Overlay architecture, 309, 312–14 Overlay construction algorithm, 319 Overlay hit rate, 317 Overlay networks, 307–26, See also caching overlays; routing overlays; security overlays architecture, 312–14 background, 309–14 deficiencies of the internet, 309–11 history of, 311–12 security benefits, 325 security overlay, 309 shortcomings alleviated by, 310–311 congestion, 310 lack of scalability, 310 lack of security, 311 outages, 310 slow adaptability, 311 Overlay paths, 319 Over-the-top (OTT) content delivery solutions, 26, 75, 119, 330, 370, 382 Packet Video Protocol, 34 Parallel transcoding/transrating technique, 152 Paraslash audio streaming software, 399–400 Parent hit rate, 317 Parent servers, 315, 316 Peering of edge cloud, 255 Peer-to-peer (P2P) overlays, 312 for content delivery, 84–6 473 streaming model, 224, 231 Percolation theory, 454 Performance testing platform, 315 Peripheral value-added services, 27–8 ad insertion, 28 network PVR, 28 on-the-fly transcoding, 27 Personal video recorder (PVR), 20 Phone Network Alliance (PNA), 41 Platform divergence, 44–5 PlatonTV, 369–83, See also scientific high definition (HD) content delivery platform access portals, 374 architecture, 372–4 availability, 381–2 components, 373 content delivery, 379–81 content delivery network, 377–9 Application Request Routing (ARR), 378 dedicated group, 378 default group, 378 LIVE case, 378 Microsoft® Internet Information Services (IIS), 378 policies for choosing, 378 PULL case, 378 PUSH case, 378 Windows Media Services (WMS), 378 content distribution and management, 376–9 content repository, 376–7 content ingest, 374–6 content processing, 374 content production, 373 content repository, 373–4 live broadcast system, 374 reliability, 381–2 Playback continuity, 222 Point of presence (PoP), Populations, 222 Portals, 277 Power-aware video streaming, 155 Practical systems for live streaming, 51–70 classic live streaming workflow, 52 constraints, 55–6 contribution feeds, preparing, 53–5 very small aperture terminal (VSAT) IP connectivity, 54 flash media, live video, 62–6 474 Practical systems for live streaming (Continued) configuring, 63–6 flash media live encoder, 62 installing, 62–3 Safari browser, 63 Wowza media server, 62 practicals, 56–9 real-world live streaming workflow, 52 shoutcast, live radio, 56–62 configuring, 57–61 installing, 56–7 testing, 61–2 VLC IP multicast on LAN, 66–9 Preboot eXecution Environment (PXE) protocol, 130 Prefetching, 84 Pricing, 167–8, 174 Princeton University, 337 Prism-based stored-TV (STV) service, 277 clients, 277 live sources, 277 portals, 277 Prism system, 276 Progressive download, 8, 18 Progressive streaming over HTTP, 143–5 PROOFS, 261 Protocols, 43–4 Proxy server location, 188–9 problem, 185 Proxy-side procedure, 264 Publish Subscribe Internet Technology (PURSUIT), 415 Pure-play CDN, 7, 329, 337, 349 Quality of experience (QoE), 222, 365–366 Quality of service (QoS), 222 Radio access network (RAN), 142, 150, 155 Radio network controller (RNC), 142 Raptor codes, 447 Rarest-first policy, 224 Real-Time Messaging Protocol (RTMP), 44, 62 Real-Time Streaming Protocol (RTSP), 40, 143 Real-Time Transport Protocol (RTP), 143 Real-Time Transport Protocol/Real-Time Streaming Protocol (RTP/RTSP), 171 INDEX Redirection, 92, 204–6, 210, 215–16, 255 Redundancy, 387–8, 392, 394 Redundancy elimination (RE), 386 Redundant traffic elimination (RTE), 361 Remote cloud, 251 REndezvous NEtwork (RENE), 415 Replacement methods, 81–4 based on request statistics, 81–4 implementation effort of, 82–3 prefetching, 84 Reporting, 162, 164, 168–74 Request redirection, 21, 26, 29, 268–9 Request reduction, 22, 24 Request routing, 91–116, 185, 186–8 using IP anycast, 94–5 mechanisms in practice, 95–6 and object placement in CDNs, 191–5 Residential Gateway (RGW), 119, 121–3, 129–30 virtual RGW (vRGW) approaches, 124 benefits of, 124 Resilient Overlay Network (RON), 312 Rich media, 451 Robust content broadcasting in vehicular networks, 431–47, See also vehicular networks CDS simulation in NS-3, 436–7 network simulation, 436 traffic simulation, 436 forward error correction techniques, 433–4 performance evaluation, 437–44 efficiency of FEC algorithm, 439 file size affects file transfer time, 440 file transfer time, 441 robust broadcast-based content delivery system, 434–6 architecture, 435 receiver, 434 transmitter, 434 Round trip time (RTT), 207–8, 211 Route controller, 96 Route optimization, 108 Routing overlays, 309, 318–23 architecture, 319–23 fast algorithms for overlay construction, 321 formulating overlay construction as multicommodity flow, 320–321 latency versus bandwidth price, 320 throughput, 320 475 INDEX performance benefits, 322 selecting the reverse proxy, 321 routing table, 39 rule development, 292, 297, 299 Safari browser, 63 Satellite news gathering (SNG) truck, 54 Scalability, 307–9, 312 Scalable video coding (SVC)-based mobile cloud streaming, 151, 153–4 Scientific high definition (HD) content delivery platform, 369–83, See also PlatonTV background, 371–2 related work, 371–2 Scientific TV, 369–84 Security, 365–6 Security overlays, 309, 323–5 Selective Broadcast, 67 Sequential caching, 14 Server, 221 server proliferation, 262 Server-side procedure, 264 Server-side scripting, 14–15 Service and content replication, 255 Service in the network graph, 229 Service-level agreement (SLA), 54, 125 Service provider (SP), 222 Service VLAN, 126 Serving and packet gateway (S/P-GW), 142 Shoutcast, 61 Signal to interference plus noise ratio (SINR), 153 Silverlight, 19 Simple Anycast (SAC), 104 Simple Load Balancing (SLB), 104 Simulation-based analysis, 436 Single-source multiple-destination caching mechanism, 385–409, See also CacheCast Single tagging, 127 Sketch-based algorithms, 279 Social cascades, 451–2, 453–6, 458, 460 characterization of cascades, 452 Software defined networking (SDN), 268–9 Software/Platform/Infrastructure-as-a-Service (S/P/IaaS), 244 Source, 221 Speedup, 315 Squid, 331 Startpos, 224 Stateless delivery, measuring, 171–3 Stateless thin-clients for DaaS applications, 131 Static content delivery, 13–14 Step, 224 Storage planning, 415, 423 Stormy, 276 Strategy, 290–291, 293, 295, 297, 299–300, 302 Stream, 221 Stream mining, 273, 275, 281–5 Stream processing engines (SPEs), 276 Streaming, 371–6, 378–9, 381, 383 Streaming over heterogeneous networks, 155 Streaming protocol success, 43–4 Structured query language (SQL), 167 Submarine communications cable system (SEA-ME-WE 4), 322 Subscription video on demand (SVoD) services, 20 Substream method in the cloud, 221, 224–6 blocksize, 224 online optimization, 226 presubstream, push versus pull, 225 sources, 226 startpos, 224 step, 224 Surrogates, 186–7, 195–8, 206–15 Swisscom, 335 Telecom Italia, 332 Telefonica, 332 Telstra, 332, 335 Temporal diffusion, 451 Thin-client devices for broadband service appliances, 130–133 Throughput model, 229–31 Trace Playback (PB), 104 Traditional streaming, 222, 223, 231 Traffic pattern, 194 Traffic simulation, 436 Transcoders architectures, types of, 147 cascaded-pixel transoder, 147 closed-loop transcoder, 147 open-loop transcoder, 147 Transcoding, 147–8, 152–5 Transmissibility, 455 476 Transmission Control Protocol (TCP), 22, 55, 143, 358–9, 364–5, 399 Transparent Transport Acceleration (TTA), 358–60 Transport layer, 40–42 Transport system, 314 Trivial File Transfer Protocol (TFTP), 130 TV platform, 369, 372, 379, 383 Unicast servers, 109 Uniform resource locator (URL), 13, 167 User-centered services, 183 User Datagram Protocol (UDP), 55, 399 User-generated content (UGC), 141, 457 User profile layer, 16 Variable bitrate, 223 Varnish, 331 Vehicle-to-infrastructure (V2I) communication, 432 Vehicle-to-vehicle (V2V) communication, 432 Vehicular ad hoc networks (VANETs), 431–47, See also robust content broadcasting in vehicular networks, 432–3, See also robust content broadcasting in vehicular networks content delivery in, 433 RoadSide Units (RSUs), 432 VANET radio communications, 433 Velocix, 332 Verizon, 332 Very Small Aperture Satellite (VSAT), 42 Very small aperture terminal (VSAT) IP connectivity, 54 Video ecosystem and CDN, 5, 10–11 Video optimization services, 146–7 Video optimizer deployment, 149 Video streaming protocols, 143–6 adaptive bitrate (ABR) streaming, 145–6 media creation and processing, 145 progressive streaming over HTTP, 143–5 buffer management, 144 controlled buffering, 144 greedy buffering, 144 Video streaming technology, evolution of, 220–222, 229, 237 Video transcoding, 147 cascaded-pixel transoder, 147 INDEX closed-loop transcoder, 147 open-loop transcoder, 147 VideoLectures.net, 372 Video-on-demand (VoD) applications, 6, 20, 46, 182–4 broadcasting, 183 cooperative caching, 183 data-centered services, 183 dynamic streaming policies, 183–4 optimization problems, 185–98 user-centered services, 183 Virtual IPTV set-top box, 132 Virtualization, 119–20, 122, 124, 126, 128–9, 132 Virtualization for cloud service delivery to home, 130–6 Virtual machine migration, 262, 268 Virtual residential gateways (vRGW), 124, 129–30 VLC IP multicast on LAN, 66–9 vMatrix, 262 Volera, 332 Web caching, 73–5 application areas, 73 client-side caches on the user equipment, 74 global content delivery networks, 74 ISP-operated CDNs, 74 for load reduction on expensive links, 74 options and properties for, 73–5 performance of, object size influence on, 81 Webcaster, 40 Web latency, 356, 359 Web performance, Wide area network (WAN), 46, 361 Wideband code division multiple access (WCDMA), 141 Windows Media Services (WMS), 378 Wireless Access for Vehicular Environment (WAVE), 433 Wireless communications, 436 Wowza media server, 52, 62, 64–6, 70 XenoServer, 262 Zipf laws, 73, 75–6, 80 WILEY SERIES ON PARALLEL AND DISTRIBUTED COMPUTING Series Editor: Albert Y Zomaya Parallel and Distributed Simulation Systems / Richard Fujimoto Mobile Processing in Distributed and Open Environments / Peter Sapaty Introduction to Parallel Algorithms / C Xavier and S S Iyengar Solutions to Parallel and Distributed Computing Problems: Lessons from Biological Sciences / Albert Y Zomaya, Fikret Ercal, and Stephan Olariu (Editors) Parallel and Distributed Computing: A Survey of Models, Paradigms, and Approaches / Claudia Leopold Fundamentals of Distributed Object Systems: A CORBA Perspective / Zahir Tari and Omran Bukhres Pipelined Processor Farms: Structured Design for Embedded Parallel Systems / Martin Fleury and Andrew Downton Handbook of Wireless Networks and Mobile Computing / Ivan Stojmenovic´ (Editor) Internet-Based Workflow Management: Toward a Semantic Web / Dan C Marinescu Parallel Computing on Heterogeneous Networks / Alexey L Lastovetsky Performance Evaluation and Characterization of Parallel and Distributed Computing Tools / Salim Hariri and Manish Parashar Distributed Computing: Fundamentals, Simulations, and Advanced Topics, Second Edition / Hagit Attiya and Jennifer Welch Smart Environments: Technology, Protocols, and Applications / Diane Cook and Sajal Das Fundamentals of Computer Organization and Architecture / Mostafa Abd-El-Barr and Hesham El-Rewini Advanced Computer Architecture and Parallel Processing / Hesham El-Rewini and Mostafa Abd-El-Barr UPC: Distributed Shared Memory Programming / Tarek El-Ghazawi, William Carlson, Thomas Sterling, and Katherine Yelick Handbook of Sensor Networks: Algorithms and Architectures / Ivan Stojmenovic´ (Editor) Parallel Metaheuristics: A New Class of Algorithms / Enrique Alba (Editor) Design and Analysis of Distributed Algorithms / Nicola Santoro Task Scheduling for Parallel Systems / Oliver Sinnen Computing for Numerical Methods Using Visual C++ / Shaharuddin Salleh, Albert Y Zomaya, and Sakhinah A Bakar Architecture-Independent Programming for Wireless Sensor Networks / Amol B Bakshi and Viktor K Prasanna High-Performance Parallel Database Processing and Grid Databases / David Taniar, Clement Leung, Wenny Rahayu, and Sushant Goel Algorithms and Protocols for Wireless and Mobile Ad Hoc Networks / Azzedine Boukerche (Editor) Algorithms and Protocols for Wireless Sensor Networks / Azzedine Boukerche (Editor) Optimization Techniques for Solving Complex Problems / Enrique Alba, Christian Blum, Pedro Isasi, Coromoto León, and Juan Antonio Gómez (Editors) Emerging Wireless LANs, Wireless PANs, and Wireless MANs: IEEE 802.11, IEEE 802.15, IEEE 802.16 Wireless Standard Family / Yang Xiao and Yi Pan (Editors) High-Performance Heterogeneous Computing / Alexey L Lastovetsky and Jack Dongarra Mobile Intelligence / Laurence T Yang, Augustinus Borgy Waluyo, Jianhua Ma, Ling Tan, and Bala Srinivasan (Editors) Research in Mobile Intelligence / Laurence T Yang (Editor) Advanced Computational Infrastructures for Parallel and Distributed Adaptive Applicatons / Manish Parashar and Xiaolin Li (Editors) Market-Oriented Grid and Utility Computing / Rajkumar Buyya and Kris Bubendorfer (Editors) Cloud Computing Principles and Paradigms / Rajkumar Buyya, James Broberg, and Andrzej Goscinski (Editors) Algorithms and Parallel Computing / Fayez Gebali Energy-Efficient Distributed Computing Systems / Albert Y Zomaya and Young Choon Lee (Editors) Scalable Computing and Communications: Theory and Practice / Samee U Khan, Lizhe Wang, and Albert Y Zomaya (Editors) The DATA Bonanza: Improving Knowledge Discovery in Science, Engineering, and Business / Malcolm Atkinson, Rob Baxter, Michelle Galea, Mark Parsons, Peter Brezany, Oscar Corcho, Jano van Hemert, and David Snelling (Editors) Large Scale Network-Centric Distributed Systems / Hamid Sarbazi-Azad and Albert Y Zomaya (Editors) Verification of Communication Protocols in Web Services: Model-Checking Service Compositions / Zahir Tari, Peter Bertok, and Anshuman Mukherjee High-Performance Computing on Complex Environments / Emmanuel Jeannot and Julius Žilinskas (Editors) Advanced Content Delivery, Streaming, and Cloud Services / Mukaddim Pathan, Ramesh K Sitaraman, and Dom Robinson (Editors) WILEY END USER LICENSE AGREEMENT Go to www.wiley.com/go/eula to access Wiley’s ebook EULA ... ADVANCED CONTENT DELIVERY, STREAMING, AND CLOUD SERVICES ADVANCED CONTENT DELIVERY, STREAMING, AND CLOUD SERVICES Edited by Mukaddim Pathan Telstra... book entitled Advanced Content Delivery, Streaming, and Cloud Services presents fundamental and trendy CDN technologies, with a comprehensive coverage of evolution, current landscape, and future... As shown in Figure 1.1, content is served into the CDN once, then content is delivered to end-users from the edge servers Advanced Content Delivery, Streaming, and Cloud Services, First Edition