This document present introductions, what is computer vision, why study computer vision, why computer vision matters, how vision is used now...
Chapter - Introduction 1-1 Chapter Introduction to Computer Vision James Hays, Brown University Department of Mechatronics Chapter - Introduction 1-2 Contents • • • • • Introductions What is Computer Vision? Why study computer vision? Why computer vision matters? How vision is used now? Department of Mechatronics 1-3 Chapter - Introduction Brief history of computer vision • 1966: Minsky assigns computer vision as an undergrad summer project • 1960’s: interpretation of synthetic worlds • 1970’s: some progress on interpreting selected images • 1980’s: ANNs come and go; shift toward geometry and increased mathematical rigor • 1990’s: face recognition; statistical analysis in vogue • 2000’s: broader recognition; large annotated datasets available; video processing starts • 2030’s: robot uprising? Department of Mechatronics Guzman ‘68 Ohta Kanade ‘78 Turk and Pentland ‘91 Chapter - Introduction 1-4 Computer Vision • Make computers understand images and video What kind of scene? Where are the cars? How far is the building? Department of Mechatronics Chapter - Introduction 1-5 What is (computer) vision? Human brain: ~100 ÷ 1.000 trillion synapses (Artificial) Neural network: ~1 ÷ 10 billion synapses Human brains have ~10.000 computational power than computer brains Lex Fridman, MIT Department of Mechatronics Chapter - Introduction 1-6 Computer Vision and Nearby Fields • Computer Graphics: Models to Images • Computer Photography: Images to Images • Computer Vision: Images to Models Department of Mechatronics Chapter - Introduction 1-7 Related disciplines Department of Mechatronics Chapter - Introduction 1-8 What is it related to? Department of Mechatronics Chapter - Introduction 1-9 The goal of computer vision • To bridge the gap between pixels and “meaning” What we see Department of Mechatronics What a computer sees 1-10 Department of Mechatronics Chapter - Introduction Chapter - Introduction 1-42 Object recognition (in mobile phones) Point & Find, Nokia Google Department of Mechatronics Chapter - Introduction 1-43 Special effects: shape capture The Matrix movies, ESC Entertainment, XYZRGB, NRC Department of Mechatronics Chapter - Introduction 1-44 Special effects: motion capture Pirates of the Carribean, Industrial Light and Magic Department of Mechatronics Chapter - Introduction 1-45 Sports Sportvision first downline Nice explanation on www.howstuffworks.com http://www.sportvision.com/video.html Department of Mechatronics Chapter - Introduction 1-46 Smart cars • Mobileye • Vision systems currently in high-end BMW, GM, Volvo, Volkswagen models • By 2010: 70% of car manufacturers Department of Mechatronics Slide content courtesy of Amnon Shashua Chapter - Introduction 1-47 Advanced Driver Assistance Systems ADAS applications • Pedestrian Detection • Blind Spot Detection • Traffic Sign Detection • Collision Avoidance • Lane Detection • Backup Obstacle Detection • Occupant Sensing Department of Mechatronics www.uurmi.com 1-48 Chapter - Introduction Traffic Sign Recognition Department of Mechatronics Chapter - Introduction 1-49 Google cars Oct 9, 2010 "Google Cars Drive Themselves, in Traffic" The New York Times John Markoff June 24, 2011 "Nevada state law paves the way for driverless cars" Financial Post Christine Dobby Aug 9, 2011, "Human error blamed after Google's driverless car sparks five-vehicle crash" The Star (Toronto) Department of Mechatronics Chapter - Introduction 1-50 Google cars • WAYMO – Self-driving car Department of Mechatronics Chapter - Introduction 1-51 Uber Self-Driving Car Department of Mechatronics Chapter - Introduction 1-52 Interactive Games: Kinect • Object Recognition: http://www.youtube.com/watch?feature=iv&v=fQ59dX Oo63o • Mario: http://www.youtube.com/watch?v=8CTJL5lUjHg • 3D: http://www.youtube.com/watch?v=7QrnwoO1-8A • Robot: http://www.youtube.com/watch?v=w8BmgtMKFbY Department of Mechatronics Chapter - Introduction 1-53 Vision in space NASA'S Mars Exploration Rover Spirit captured this westward view from atop a low plateau where Spirit spent the closing months of 2007 Vision systems (JPL) used for several tasks • • • • Panorama stitching 3D terrain modeling Obstacle detection, position tracking For more, read “Computer Vision on Mars” by Matthies et al Department of Mechatronics Chapter - Introduction 1-54 Industrial robots Vision-guided robots position nut runners on wheels Department of Mechatronics Chapter - Introduction 1-55 Mobile robots NASA’s Mars Spirit Rover http://en.wikipedia.org/wiki/Spirit_rover Department of Mechatronics http://www.robocup.org/ Saxena et al 2008 STAIR at Stanford Chapter - Introduction 1-56 Medical imaging 3D imaging MRI, CT Department of Mechatronics Image guided surgery Grimson et al., MIT ... Mechatronics Chapter - Introduction 1-6 Computer Vision and Nearby Fields • Computer Graphics: Models to Images • Computer Photography: Images to Images • Computer Vision: Images to Models Department...Chapter - Introduction 1-2 Contents • • • • • Introductions What is Computer Vision? Why study computer vision? Why computer vision matters? How vision is used now? Department... Mechatronics Chapter - Introduction 1-21 Why study computer vision? • Vision is useful • Vision is interesting • Vision is difficult Half of primate cerebral cortex is devoted to visual processing