Renesas Electronics America Inc. © 2012 Renesas Electronics America Inc. All rights reserved. Active Safety Solutions © 2012 Renesas Electronics America Inc. All rights reserved.2 Renesas Technology & Solution Portfolio © 2012 Renesas Electronics America Inc. All rights reserved.3 Challenge: “In the smart society, vehicles are incorporating more intelligence to detect threats, and then warn the driver and/or automatically respond (i.e. emergency braking). The computing solutions behind these active safety systems must balance high performance against requirements for integration and low power consumption.” Solution: “Renesas focuses on adding specialized hardware to active safety solutions to add performance with lower power, allowing for higher integration.” ‘Enabling The Smart Society’ © 2012 Renesas Electronics America Inc. All rights reserved.4 Microcontroller and Microprocessor Line-up Wide Format LCDs Industrial & Automotive, 130nm 350µA/MHz, 1µA standby 44 DMIPS, True Low Power 1800 DMIPS, Performance 1200 DMIPS, Superscalar 500 DMIPS, Low Power 25 DMIPS, Low Power 10 DMIPS, Capacitive Touch Industrial & Automotive, 150nm 190µA/MHz, 0.3µA standby Automotive & Industrial, 90nm 600µA/MHz, 1.5µA standby Automotive & Industrial, 65nm 600µA/MHz, 1.5µA standby Automotive, 40nm 500µA/MHz, 35µA deep standby Industrial & Automotive, 130nm 144µA/MHz, 0.2µA standby 2010 2013 32-bit8/16-bit Up to 30K DMIPS, Performance Cortex A7 or A15-based Automotive, 28nm *tentative naming * © 2012 Renesas Electronics America Inc. All rights reserved.5 Active Safety Solutions by Renesas MP Start 2009 2011 2013 2015 2017 SH7766 w/ Signal Processing HW IMAPCAR2 w/ Signal Processing HW SH7766-L w/ Signal Processing HW Dot-MatrixDot-MatrixSoC System-on-Chip External Memory SH7455/6 200MHz DSP by FPU MCU Internal Memory Performance As process technology advances, more performance can be packaged with internal memory Performance requirements continue to grow at high end Microcontroller RH850-based System-on-Chip ARM-based *tentative naming * © 2012 Renesas Electronics America Inc. All rights reserved.6 Introduction to “ADAS” ADAS Systems Overview Renesas Solutions SH7766 / TopView Sensor Fusion Smart Sensor Ecosystem Ethernet AVB in ADAS Functional Safety Agenda © 2012 Renesas Electronics America Inc. All rights reserved.7 Introduction © 2012 Renesas Electronics America Inc. All rights reserved.8 Key Term: ADAS “Advanced Driver Assistance Systems” High level description of ADAS: Monitor the vehicle and its environment If a threat or other notable event is detected – Alert the driver – And/or take action Goal: Provide the vehicle and driver greater ability to avoid accidents ADAS Definition © 2012 Renesas Electronics America Inc. All rights reserved.9 Object detection and collision avoidance Parking assistance Back-up camera Surround-view Self-parking Traffic Sign Recognition Lane departure warning / lane keeping Night Vision Augmented reality Headlight control (Automatic dimming of high beams) Driver monitoring (distracted/drowsy driver) ADAS Application Examples © 2012 Renesas Electronics America Inc. All rights reserved.10 Major steps Collect sensor data on DSP (radar or camera) Analyze data (object detection) Communicate to other vehicle systems to take appropriate actions, as needed – Steering – Braking – Audio system (to warn driver) – etc. ADAS Application Architecture DSP Host Control Flash Car Network DDR RAM Sensor Data Today Complex PCB for high-speed RAM access [...]... Technologies w/ Signal Processing HW Performance SH7766 Signal Processing HW Image Distortion Correction HW Functional Safety Etc R-Car/V ARM CPU’s w/ Signal Processing HW IMAPCAR2 w/ Signal Processing HW SH7766-L w/ Signal Processing HW Key Technologies Signal Processing HW Functional Safety High-performance Flash Etc RH850/V RH850 CPU’s w/ Signal Processing HW SH7455/6 200MHz DSP by FPU *tentative naming... Action Warning CAN/Flexray Front Cam ECU Ethernet/CAN/Flexray Top-View ECU Braking Throttle HMI * Sensor Fusion Solutions Update rate and number of sensors can drive CPU performance requirements for fusion Break up processing tasks for more sensors If output is to steering/braking/throttle, safety requirements are increased Enable higher ASIL levels for decisions & communication Compile Analysis... End More Sensors © 2012 Renesas Electronics America Inc All rights reserved High End Many Sensors *tentative naming Smart Sensor Solutions Sensor fusion may require processing of raw radar or camera data “somewhere else”, outside of the fusion controller Highly integrated solutions such as the RH850/V series make it easier to package the processing with the sensor 33 © 2012 Renesas Electronics America... © 2012 Renesas Electronics America Inc All rights reserved Before After (b) Bright area control After Next-gen Top-View: Moving to ARM Similar concepts as SH7766 Focus on Digital Cameras, higher resolutions Support Ethernet AVB Camera Networks or Direct Input Use dedicated HW – IMR-LSX2 next-gen – H.264 Decode 1Gb EtherAVB GMII 2D Graphics Gbit Ether AVB H.264/MJPEG decoder OR 1280x1024 Camera... conditions: From ADAS – Understand position and obstacles through radar & cameras – Take action through steering, brakes, and throttle 14 © 2012 Renesas Electronics America Inc All rights reserved Renesas Solutions for ADAS 15 © 2012 Renesas Electronics America Inc All rights reserved Integration Target Today Target Flash Sensor Data DSP Complex PCB for high-speed RAM access RAM Host Control Integrate... and processing capability adds weight and power consumption Reduces range of Electric Vehicles Reduces mpg when government regulation pushes manufacturers to higher standards Renesas goal: Offer solutions that enable higher integration and lower power 12 © 2012 Renesas Electronics America Inc All rights reserved ADAS Application Growth 30.00 2011 2015 2019 25.00 20.00 15.00 10.00 5.00 0.00 Sensor... SRAM (2.5MB) and Flash (4MB) integration © 2012 Renesas Electronics America Inc All rights reserved Ecosystem 35 © 2012 Renesas Electronics America Inc All rights reserved Customer Deployment Needs Solutions • Lane Departure • Object Detection, • …etc Optimized Libraries • OpenCV • OpenVL Custom Development • Compilers, etc 36 © 2012 Renesas Electronics America Inc All rights reserved Renesas is . Renesas Electronics America Inc. © 2012 Renesas Electronics America Inc. All rights reserved. Active Safety Solutions © 2012 Renesas Electronics America Inc. All rights reserved.2 Renesas Technology. the driver and/or automatically respond (i.e. emergency braking). The computing solutions behind these active safety systems must balance high performance against requirements for integration. and low power consumption.” Solution: “Renesas focuses on adding specialized hardware to active safety solutions to add performance with lower power, allowing for higher integration.” ‘Enabling