Active Safety Solutions

Renesas Electronics America Inc. © 2012 Renesas Electronics America Inc. All rights reserved. Active Safety Solutions © 2012 Renesas Electronics America Inc. All rights reserved.2 Renesas Technology & Solution Portfolio © 2012 Renesas Electronics America Inc. All rights reserved.3  Challenge: “In the smart society, vehicles are incorporating more intelligence to detect threats, and then warn the driver and/or automatically respond (i.e. emergency braking). The computing solutions behind these active safety systems must balance high performance against requirements for integration and low power consumption.”  Solution: “Renesas focuses on adding specialized hardware to active safety solutions to add performance with lower power, allowing for higher integration.” ‘Enabling The Smart Society’ © 2012 Renesas Electronics America Inc. All rights reserved.4 Microcontroller and Microprocessor Line-up Wide Format LCDs  Industrial & Automotive, 130nm  350µA/MHz, 1µA standby 44 DMIPS, True Low Power 1800 DMIPS, Performance 1200 DMIPS, Superscalar 500 DMIPS, Low Power 25 DMIPS, Low Power 10 DMIPS, Capacitive Touch  Industrial & Automotive, 150nm  190µA/MHz, 0.3µA standby  Automotive & Industrial, 90nm  600µA/MHz, 1.5µA standby  Automotive & Industrial, 65nm  600µA/MHz, 1.5µA standby  Automotive, 40nm  500µA/MHz, 35µA deep standby  Industrial & Automotive, 130nm  144µA/MHz, 0.2µA standby 2010 2013 32-bit8/16-bit Up to 30K DMIPS, Performance  Cortex A7 or A15-based  Automotive, 28nm *tentative naming * © 2012 Renesas Electronics America Inc. All rights reserved.5 Active Safety Solutions by Renesas MP Start 2009 2011 2013 2015 2017 SH7766 w/ Signal Processing HW IMAPCAR2 w/ Signal Processing HW SH7766-L w/ Signal Processing HW Dot-MatrixDot-MatrixSoC System-on-Chip External Memory SH7455/6 200MHz DSP by FPU MCU Internal Memory Performance As process technology advances, more performance can be packaged with internal memory Performance requirements continue to grow at high end Microcontroller RH850-based System-on-Chip ARM-based *tentative naming * © 2012 Renesas Electronics America Inc. All rights reserved.6  Introduction to “ADAS”  ADAS Systems Overview  Renesas Solutions  SH7766 / TopView  Sensor Fusion  Smart Sensor  Ecosystem  Ethernet AVB in ADAS  Functional Safety Agenda © 2012 Renesas Electronics America Inc. All rights reserved.7 Introduction © 2012 Renesas Electronics America Inc. All rights reserved.8  Key Term: ADAS “Advanced Driver Assistance Systems”  High level description of ADAS:  Monitor the vehicle and its environment  If a threat or other notable event is detected – Alert the driver – And/or take action  Goal: Provide the vehicle and driver greater ability to avoid accidents ADAS Definition © 2012 Renesas Electronics America Inc. All rights reserved.9  Object detection and collision avoidance  Parking assistance  Back-up camera  Surround-view  Self-parking  Traffic Sign Recognition  Lane departure warning / lane keeping  Night Vision  Augmented reality  Headlight control (Automatic dimming of high beams)  Driver monitoring (distracted/drowsy driver) ADAS Application Examples © 2012 Renesas Electronics America Inc. All rights reserved.10  Major steps  Collect sensor data on DSP (radar or camera)  Analyze data (object detection)  Communicate to other vehicle systems to take appropriate actions, as needed – Steering – Braking – Audio system (to warn driver) – etc. ADAS Application Architecture DSP Host Control Flash Car Network DDR RAM Sensor Data Today Complex PCB for high-speed RAM access [...]... Technologies w/ Signal Processing HW Performance SH7766 Signal Processing HW Image Distortion Correction HW Functional Safety Etc R-Car/V ARM CPU’s w/ Signal Processing HW IMAPCAR2 w/ Signal Processing HW SH7766-L w/ Signal Processing HW Key Technologies Signal Processing HW Functional Safety High-performance Flash Etc RH850/V RH850 CPU’s w/ Signal Processing HW SH7455/6 200MHz DSP by FPU *tentative naming... Action Warning CAN/Flexray Front Cam ECU Ethernet/CAN/Flexray Top-View ECU Braking Throttle HMI * Sensor Fusion Solutions  Update rate and number of sensors can drive CPU performance requirements for fusion  Break up processing tasks for more sensors  If output is to steering/braking/throttle, safety requirements are increased  Enable higher ASIL levels for decisions & communication Compile Analysis... End More Sensors © 2012 Renesas Electronics America Inc All rights reserved High End Many Sensors *tentative naming Smart Sensor Solutions  Sensor fusion may require processing of raw radar or camera data “somewhere else”, outside of the fusion controller  Highly integrated solutions such as the RH850/V series make it easier to package the processing with the sensor 33 © 2012 Renesas Electronics America... © 2012 Renesas Electronics America Inc All rights reserved Before After (b) Bright area control After Next-gen Top-View: Moving to ARM  Similar concepts as SH7766  Focus on Digital Cameras, higher resolutions  Support Ethernet AVB Camera Networks or Direct Input  Use dedicated HW – IMR-LSX2  next-gen – H.264 Decode 1Gb EtherAVB GMII 2D Graphics Gbit Ether AVB H.264/MJPEG decoder OR 1280x1024 Camera... conditions: From ADAS – Understand position and obstacles through radar & cameras – Take action through steering, brakes, and throttle 14 © 2012 Renesas Electronics America Inc All rights reserved Renesas Solutions for ADAS 15 © 2012 Renesas Electronics America Inc All rights reserved Integration Target Today Target Flash Sensor Data DSP Complex PCB for high-speed RAM access RAM Host Control Integrate... and processing capability adds weight and power consumption  Reduces range of Electric Vehicles  Reduces mpg when government regulation pushes manufacturers to higher standards  Renesas goal: Offer solutions that enable higher integration and lower power 12 © 2012 Renesas Electronics America Inc All rights reserved ADAS Application Growth 30.00 2011 2015 2019 25.00 20.00 15.00 10.00 5.00 0.00 Sensor... SRAM (2.5MB) and Flash (4MB) integration © 2012 Renesas Electronics America Inc All rights reserved Ecosystem 35 © 2012 Renesas Electronics America Inc All rights reserved Customer Deployment Needs Solutions • Lane Departure • Object Detection, • …etc Optimized Libraries • OpenCV • OpenVL Custom Development • Compilers, etc 36 © 2012 Renesas Electronics America Inc All rights reserved Renesas is . Renesas Electronics America Inc. © 2012 Renesas Electronics America Inc. All rights reserved. Active Safety Solutions © 2012 Renesas Electronics America Inc. All rights reserved.2 Renesas Technology. the driver and/or automatically respond (i.e. emergency braking). The computing solutions behind these active safety systems must balance high performance against requirements for integration. and low power consumption.”  Solution: “Renesas focuses on adding specialized hardware to active safety solutions to add performance with lower power, allowing for higher integration.” ‘Enabling