IPoDWDM deep dive Jusep Unserman

IPoDWDM and IP NGN Core design Josef Ungerman Cisco, CCIE #6167 © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential • Motivations for IP NGN • Trends is IP/MPLS Core Design • Making Routers Cheaper • IPoDWDM • Pre-FEC proactive protection • 100GE and 40GE • Future © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential IP Traffic will increase 4x from 2009 to 2014 (34% CAGR) IP Traffic IP Traffic grew 45% in 2009 Mobile Data Traffic will double every year Video will be 66% of mobile data, and 91% of global traffic Internet Traffic © 2010 Cisco and/or its affiliates All rights reserved Source: Cisco Visual Networking Index—Forecast, 2009–2014 [Cisco VNE] Business IP traffic will increase 2.6x (21% CAGR), only video will grow 10x Central & Eastern Europe will be 2.3EB/month (3.6% of the global 64EB/month) Cisco Confidential How to move bits cheaper .reduce OPEX, CAPEX, and keep reasonable quality? 1) Reduce the number of networks 2) Reduce the number of layers 3) Reduce the number of nodes 4) Reduce the number of links 5) Use modern technologies the largest portion of the traffic will rule the design the largest portion of the traffic must be as close to fiber as possible, eliminate overlay the largest portion of the traffic must pass the lowest possible number of nodes the number of changes in the network must be minimal when adding more capacity; use statistical multiplex - small traffic follows big traffic Watch TCO, Price/Performance ratio, Watt/Gigabit ratio, investment protection (h/w upgradeability, s/w roadmaps) © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential • IP NGN = Single Multiservice Network Not multiple single-service networks Key enablers are Virtualization, QoS and Security • IP NGN = MPLS + DWDM Optical Transport Moving bits cheaper 100GE evolution, Price/Gigabit and Watt/Gigabit reduction • IP NGN = optimal balance between Clouds and Circuits Statistical Multiplex (IP/MPLS, MPLS-TP) and Division Multiplex (DWDM, OTN) © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential Designing End to End IP/MPLS networks Hierarchy Hierarchical Design (divide & conquer approach) PE is always connected to P Simple upgrades Static Transport Layer Protection is in the IP domain © 2010 Cisco and/or its affiliates All rights reserved Router Bypass • Hierarchical Design with optical router bypass • Still simple upgrades • Cheaper bandwidth • Quality is kept Hollow Core idea Flat Design (full mesh between IP routers) Fewer nodes, Much more Links Complex upgrades, complex QoS Dynamic Transport Layer (G.MPLS, VCAT/ODU-FLEX) Protection in the Optical domain Cisco Confidential Metro Aggregation BNG (Edge) The The Quality Quality of of IP IP NGN NGN Design Design •• Hierarchy Hierarchy (P (P is is connected connected to to PE) PE) •• One One network, network, one one IGP IGP (not (not multiple) multiple) •• QoS QoS and and Security Security everywhere everywhere •• Scalability Scalability –– where where will will 40/100GE 40/100GE start? start? SSN – Single Service Node (eg BRAS, IGW) MSN – Multiservice Node (eg P router) Core •SSN-MSN link = ok Internet Gateways safe operation •MSN-MSN link = think twice! such link needs proper QoS and capacity mgt •SSN-SSN link = stop! don’t break the hierarchy, don’t create another net © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential Statistical Multiplexing Creates an IP hierarchy DWDM or dark fiber – direct link (optical layer bypass) Creates an IP mesh Too large distances – OTN switch (transport layer bypass) © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 100GE IEEE 802.3ba ratified CRS-3 today, in 2011/12 also ASR9K & Nexus7K OTN (Optical Transport Network) OTN Framing implemented today for Ethernet interfaces – ITU-T G.709 CRS, ASR9000, 7600, CPT, ONS (ODU2e, ODU3, future ODU4) OTN Aggregation implemented today for 10GE ONS15454 Muxponder ODU3 (future Any-Rate, ODU4, MPLS-TP) OTN Switching geographically very large countries, or very dense 10G E-Line networks (G.MPLS) developed for next generation portfolio © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 10 High Speed Ethernet Standard Interfaces © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 43 High Speed Ethernet – Not To Exceed Pricing Estimated Not to Exceed List Prices (Industry-wide) © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 44 Historical Adoption of High Speed Ethernet © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 45 High-Speed Transceivers Form Factors 30 pins 1x10G 20 pins 1x10G E-interface: 70 pins 4x3.125G All units are in millimeters and round numbers © 2010 Cisco and/or its affiliates All rights reserved CXP* 18 38 pins 4x10G CFP 82 ~24 140 13 QSFP TBD 18 115 E-interface: 70 pins 4x3.125G SFP+ 70 max 36 77 36 XFP 56 X2 70 Xenpak E-interface: 84 pins Tx: 12x10G Rx: 12x10G E-interface: 148 pins 4x10G (XLAUI) 10x10G (CAUI) Cisco Confidential 46 High-Speed Ethernet Transceiver Landscape 40G/100G CFP 40G QSFP Applications: Applications: Power Consumption: Power Consumption: Single Mode Fiber 10-40+Km Multimode Parallel Fiber Twinax Copper Convertible in to 4x10GbE (SFP+) Up to 8W @ 40GbE Up to 25W @ 100GbE © 2010 Cisco and/or its affiliates All rights reserved Multimode Parallel Fiber Twinax Copper Future (?) 10 Km Single Mode Up to 3.5W Cisco Confidential 47 High-Speed Ethernet Transceiver Landscape 100GbE CFP requires “Riding HeatSink” SMF optimized CFP features a new concept known as the riding heat sink, in which the heat sink is attached to rails on the host card and “rides” on top of the CFP, which is flat topped © 2010 Cisco and/or its affiliates All rights reserved 100GbE CXP MMF/Twinax optimized CXP was created to satisfy the high-density requirements of the data center, targeting parallel interconnections for 12x QDR InfiniBand (120 Gbps), 100 GbE, and proprietary links between systems collocated in the same facility The InfiniBand Trade Association is currently standardizing the CXP Cisco Confidential 48 Interface Module 1x 100GBE Line-rate performance (100Gbps) CFP optics (LR4) Forwarding Processor FP-140 – Core & Peering @ 140 Gbps queues per port, ACL, Netflow MSC-140 – High-speed edge @ 140Gbps HQoS, 64,000 queues, 12,000 interfaces © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 49 NG Router Hardware Roadmap 2010 2009 CRS 40G 2011 CRS 140G per slot per slot per slot per slot STM-256 OTU3 © 2010 Cisco and/or its affiliates All rights reserved per slot ASR9000 200G ASR9000 80G 100GE 10GE OTU2e CRS 400G per slot 7600 ES+ 40G STM-256 2012 100GE OTU4 40GE OTU3e 10GE OTU2e 10GE OTU2e 100GE 40GE 100GE/40GE OTU Cisco Confidential 50 Data Center • Catalyst 6500: 4-port 40G module 80Gbps/60Mpps, CFP transceivers 16x 10GE version also available • Nexus 7000: 6-port 40G module 240Gbps/120Mpps, QSFP transceivers (focused on DC distances) • Nexus 7000: 2-port 100G module (40/100) 200Gbps/120Mpps, CFP transceivers (focused on wide-area distances) Target FCS CY11 © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 51 25Gb/s In-phase QPSK1 Modulator Laser 25Gb/s 25Gb/s Quadrature 100 Gb/s = 25 Gbaud In-phase QPSK2 Modulator 25Gb/s Quadrature Laser 90° Hybrid 90° Hybrid PIN PIN PIN PIN i0 q0 i1 q1 4x 50G ADC • PM – QPSK – Pol Mux Quadrature Phase Shift Keying Signal Processing Optical Linear System • Increase distances utilizing Cisco Advanced FEC • Advanced signal processing to address: CD Compensation PMD Mitigation Single Channel Non-linear impairment mitigation • To be implemented on both router interfaces and transport NEs © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 52 • Higher data rates 200Gig, 400Gig, 1T? Research for CRS, ASR, Nexus, ONS • Need to investigate other modulation techniques PM-16QAM, PM-64QAM, … or CO-OFDM ? • Need deeper look at FEC Advanced FEC What other algorithms are there • Need of intelligent DWDM layer Flex spectrum Control plane Advanced operations, troubleshooting and protection mechanisms © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 53 • Motivations for IP NGN – traffic growth • Trends is IP/MPLS Core Design – cost reduction • Moore’s Law – making routers cheaper • IPoDWDM and proactive protection • 40GE,100GE and Beyond © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 54 Thank you Registrujte se za Cisco Live Networkers u Londonu ili Bahreinu! Više informacija na: http://www.ciscolive.com/ Presentation_ID © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 56 © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 57 [...]... OEO Addt’l transponder & SR for each λ Expensive switch w/active electronics Continue to Invest in XCs & Transponders © 2010 Cisco and/or its affiliates All rights reserved IPoDWDM Solution Router Tunable DWDM I/F ROADMs Invest in IPoDWDM 0 transponders needed 2 Tunable DWDM interfaces in router All pass-through traffic stays optical ROADM full provisioned, no truck rolls Expensive switch eliminated... All rights reserved Cisco Confidential 34 Router topology SRLG={1,2,3} Optical topology 1 ! 2 3 – FRR decides protection path ahead of a failure – Can be wrong w/o SRLG data What appears diverse in L2/L3 may not be diverse in L1 – Manual SRLG entry is error prone and not up to date – SRLGs can be mined from the Optical layer and fed to IP layer Enhance network resilience w/o error-prone manual work... 40G fabric interface (instead of 1x 80G fabric interface) 8/16 queues per port (instead of thousands) lower-scale NPU (no need for thousands of interfaces) licenses for features that not everybody uses (IPoDWDM, SyncE, VPN, ) 2:1 ingress overbooking (eg GPON Aggregation or Intra PoP PE links) newer chips, fewer chips = 50+% Watt-per-Gigabit savings © 2010 Cisco and/or its affiliates All rights reserved... (max.) CRS-1 MSC40 + 4xTGE 125 W 7600 76-ES+4T 100 W MSC/FP + 14xTGE 43 W CRS-1 ASR9000 CRS-3 © 2010 Cisco and/or its affiliates All rights reserved FP40 + 4xTGE 105 W A9K-8T 78 W Cisco Confidential 19 IPoDWDM Presentation_ID © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 20 OTN OEO SDH/SONET Solution Router Transponders or DWDM I/F Short Reach Optics I/F Cross Connect (XC)... Database Alarm Config Comm Inside the NE (IPC) Traditional Network © 2010 Cisco and/or its affiliates All rights reserved Virtual Transponder Representation in Info Model DWDM Router Interfaces Alarm LMP IPoDWDM: Can Be Managed w/out Significant Changes Cisco Confidential 36 ... Transponders © 2010 Cisco and/or its affiliates All rights reserved IPoDWDM Solution Router Tunable DWDM I/F ROADMs Invest in IPoDWDM transponders needed Tunable DWDM interfaces in router All pass-through... decides protection path ahead of a failure – Can be wrong w/o SRLG data What appears diverse in L2/L3 may not be diverse in L1 – Manual SRLG entry is error prone and not up to date – SRLGs can be... Interfaces Alarm LMP IPoDWDM: Can Be Managed w/out Significant Changes Cisco Confidential 36 © 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 37 CESNET 40G IPoDWDM Testing