Trí tuệ nhân tạo rolling in the deep

Rolling in the Deep with Anh T Tra anhttra@hitachiconsulting.com April 22, 2019 CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 Outlines Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification QnA CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 Introduction About Us Anh T Tra Sr Consultant Global CyberSoft (HCVN) Phong T Le Consultant Global CyberSoft (HCVN) Quan Nguyen Software Engineer D-Soft anhttra@hitachiconsulting.com phongtle@hitachiconsulting.com quannv@d-soft.com.vn CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification QnA CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance AI/ML/DL Figure 1: Big picture about AI/ML/DL1 http://introtodeeplearning.com/materials/2019_6S191_L1.pdf CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance ML/DL Timeline Figure 1: Timeline of the development of deep learning and commonly-used machine learning algorithms2 Cao, Chensi, et al ”Deep learning and its applications in biomedicine.” Genomics, proteomics & bioinformatics 16.1 (2018): 17-32 CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance ML vs DL Figure 1: Comparison between Machine Learning and Deep Learning3 https://towardsdatascience.com/why-deep-learning-is-needed-over-traditional-machine-learning-1b6a99177063 CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance Neural Network Recap CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 On the Surface: AI/ML/DL at the glance Neural Network Recap • A Neural Network is a function! • It (generally) comprised of: • Neurons which pass input values through functions and output the result • Weights which carry values between neurons • We group neurons into layers There are main types of layers: • Input Layer • Hidden Layer • Output Layer • Train a Neural Network = Find good Weights: θ = argminθ loss(y (x ), hθ (x )) (1) x CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 / 19 In the Deep: Deep Learning and TensorFlow Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification QnA CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 10 / 19 In the Deep: Deep Learning and TensorFlow Deep Learning in One slide • What is it: • • • • Extract useful patterns from data How: Neural network + optimization How (Pratical): Python + TensorFlow & friends Hart Part: Good Question + Good Data Why now: Data, hardware, community, tools, invesment CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) Exciting progress: • Face recognition • Image classification • Speech recognition • Text-to-speech generation • Handwriting transcription • Medical diagnosis • Cars: drivable area, lane keeping • Digital assistants • Ads, search, social recommendations • Game playing with deep RL https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 11 / 19 In the Deep: Deep Learning and TensorFlow History of DL Tools • Torch - 2002 • CUDA - 2007 • Theano - 2008 • Caffe - 2014 • TensorFlow 0.1 - 2015 • PyTorch 0.1 - 2017 • TensorFlow 1.0 - 2017 • PyTorch 1.0 - 2017 • TensorFlow 2.0 - 2019 CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 12 / 19 In the Deep: Deep Learning and TensorFlow TensorFlow in One Slide • What is it: Deep Learning Library • Facts: Open Source, Python, Google • Community: • 117,000+ GitHub stars • TensorFlow.org: Blogs, Documentation, DevSummit, YouTube talks • Ecosystem: • Keras: high-level API • TensorFLow.js: in the browser • TensorFlow Lite: on the phone • Colaboratory: in the cloud • TPU: optimized hardware • TensorBoard: visualization • TensorFlow Hub: graph modules • Alternatives: PyTorch, MXNet, CNTK CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 13 / 19 DL Interesting Applications Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification QnA CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 14 / 19 DL Interesting Applications Image Style Transfer • Introduction: https://www.youtube.com/watch?v=R39tWYYKNcI • Web application: https://deepdreamgenerator.com/ CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 15 / 19 DL Interesting Applications Real-time Object Detection • Papers: • Redmon, Joseph, et al ”You only look once: Unified, real-time object detection.” Proceedings of the IEEE conference on computer vision and pattern recognition 2016 • Redmon, Joseph, and Ali Farhadi ”YOLO9000: better, faster, stronger.” Proceedings of the IEEE conference on computer vision and pattern recognition 2017 • Redmon, Joseph, and Ali Farhadi ”Yolov3: An incremental improvement.” arXiv preprint arXiv:1804.02767 (2018) • Video demo: https://www.youtube.com/watch?v=MPU2HistivI CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 16 / 19 Demo: Dog/Cat Classification Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification QnA CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 17 / 19 Demo: Dog/Cat Classification Dog/Cat classification Source code: https://github.com/anhttra/gdg-mientrung-2019 CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 18 / 19 QnA Question and Answer CuuDuongThanCong.com Anh T Tra (HCVN - Global CyberSoft) https://fb.com/tailieudientucntt TensorFlow MEETUP 2019 April 22, 2019 19 / 19 ... 2019 April 22, 2019 / 19 In the Deep: Deep Learning and TensorFlow Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo:... 2019 April 22, 2019 13 / 19 DL Interesting Applications Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat...Outlines Introduction On the Surface: AI/ML/DL at the glance In the Deep: Deep Learning and TensorFlow DL Interesting Applications Demo: Dog/Cat Classification