(Luận văn thạc sĩ) study on supervision and control of robot over computer network, nghiên cứu vấn đề giám sát và điều khiển robot qua mạng máy tính

VIETNAM NATIONAL UNIVERSITY, HANOI -VNU UNIVERSITY OF ENGINEERING AND TECHNOLOGY Phung Manh Duong STUDY ON SUPERVISION AND CONTROL OF ROBOT OVER COMPUTER NETWORK DOCTORAL THESIS IN ELECTRONICS AND TELECOMMUNICATIONS TECHNOLOGY Hanoi - 2015 VIETNAM NATIONAL UNIVERSITY, HANOI -VNU UNIVERSITY OF ENGINEERING AND TECHNOLOGY Phung Manh Duong STUDY ON SUPERVISION AND CONTROL OF ROBOT OVER COMPUTER NETWORK Major: Electronic Engineering Code: 62 52 70 01 DOCTORAL THESIS IN ELECTRONICS AND TELECOMMUNICATIONS TECHNOLOGY SUPERVISOR: Assoc Prof Dr Tran Quang Vinh Hanoi - 2015 ĐẠI HỌC QUỐC GIA HÀ NỘI -TRƯỜNG ĐẠI HỌC CÔNG NGHỆ Phùng Mạnh Dương NGHIÊN CỨU VẤN ĐỀ GIÁM SÁT VÀ ĐIỀU KHIỂN ROBOT QUA MẠNG MÁY TÍNH Chuyên ngành: Kỹ thuật Điện tử Mã số: 62 52 70 01 LUẬN ÁN TIẾN SĨ NGÀNH CÔNG NGHỆ ĐIỆN TỬ - VIỄN THÔNG NGƯỜI HƯỚNG DẪN KHOA HỌC: PGS.TS Trần Quang Vinh Hà Nội - 2015 DECLARATION BY CANDIDATE I hereby declare that this thesis is my own work and effort and that it has not been submitted anywhere for any award Where other sources of information have been used, they have been acknowledged Author Phung Manh Duong i Acknowledgements This thesis has been completed with the contributions of many people First of all, I would like to express my special thanks Prof Tran Quang Vinh, my supervisor, for his guidance, encouragement, and support I was truly fortunate to have the opportunity to work with him as a PhD student I am greatly indebted to Prof Kok Kiong Tan and the members of Mechatronics and Automation Laboratory for their support and advices during my research in National University of Singapore I am grateful to Ms Nguyen Thi Thanh Van and Mr Tran Thuan Hoang for their supports on simulation and experiment in my research I would like to express my appreciation to the teachers and students in VNU-UET When I started working in this college, I immediately noticed and valued the high level of communication and the free flow of ideas here I appreciate the National Foundation for Science and Technology Development (NAFOSTED) for their financial support for my attendance of international conferences Finally, I owe special thanks to my family, who always accept and encourage my decisions in the professional and the personal fields over the past years ii Contents List of Abbreviations vi List of Tables viii List of Figures ix Chapter 1: Introduction 1.1 Introduction to networked robot systems 1.2 Applications of networked robot systems .2 1.2.1 Industrial networked robots 1.2.2 Educational networked robots 1.2.3 Medical networked robots 1.2.4 Service networked robots .5 1.2.5 Other networked robots 1.2.6 Networked robots in Vietnam 1.3 Related works 1.3.1 Study of NRSs on localization 1.3.2 Study of NRSs on stabilization control .10 1.3.3 Study of NRSs on navigation 11 1.4 The goal of the research .13 1.5 The organization of this thesis .14 Chapter 2: System Model .16 2.1 State-space representation of the NRS 16 2.2 The communications network .22 2.2.1 Network types .22 2.2.2 Network characteristics .25 2.3 The Robot 29 2.3.1 Hardware configuration 29 2.3.2 Data communications 35 2.4 Conclusion 42 Chapter 3: Localization Using Optimal Filter .43 iii 3.1 Robot localization 43 3.2 Localization of NRSs 44 3.3 Localization of NRSs using past-observation based extended Kalman filter 45 3.3.1 The standard Kalman filter 46 3.3.2 Optimal filter for linear NRSs 47 3.3.3 Optimal filter for nonlinear NRSs 54 3.4 Implementation of the PO-EKF for the differential-drive network robot 55 3.4.1 Measurement of network state 55 3.4.2 Implementation of the prediction phase .56 3.4.3 Implementation of the correction phase .57 3.5 Simulations 58 3.5.1 Simulation setup 58 3.5.2 Simulation result 63 3.6 Experiments 66 3.6.1 Experimental setup .67 3.6.2 Experimental result .68 3.7 Discussion 73 3.8 Conclusion 75 Chapter 4: Motion Control Using Lyapunov Stability Theory and Predictive Filter 76 4.1 Introduction 76 4.2 Problem formulation 77 4.3 Stabilization of non-networked robot system 81 4.4 Stabilization of NRS 83 4.5 Simulations 85 4.6 Experiments 90 4.7 Discussion 92 4.8 Conclusion 95 Chapter 5: Navigation Using Behavior-based Model 96 iv 5.1 Introduction 96 5.2 Behavior-based navigation for NRSs 98 5.2.1 User following 99 5.2.2 Obstacle avoidance .102 5.2.3 Goal reaching 105 5.2.4 Supervisory module 105 5.3 Simulations 106 5.4 Experiments 110 5.5 Conclusion 116 Chapter 6: Conclusion 117 List of Publications Related to This Thesis 121 References 123 v List of Abbreviations 2D Two-dimensional 3D Three-dimensional ADSL Asymmetric digital subscriber line ALCAP Access link control application part ARP Address resolution protocol CAN Controller area network CCD Charge-coupled device CSMA/CD Carrier sense multiple access with collision detection DARPA Defense advanced research projects agency EKF Extended Kalman filter FIP Factory instrumentation protocol GPS Global positioning system GUI Graphic user interface HTTP Hypertext transfer protocol ICMP Internet control message protocol ID Identifier IETF Internet engineering task force IGMP Internet group management protocol IP Internet protocol IRTP Interactive real-time protocol ISP Internet service providers LAN Local area network LAS Link active scheduler LEKF Lucas-extended Kalman filter LRF Laser range finder MAC Media access control vi MSSR Multi-sensor smart robot NRS Networked robot system NRSs Networked robot systems NS2 Network simulator ns-2 PC Personal computer PID Proportional-integral-derivative PO-EKF Past observation-based extended Kalman filter PO-KF Past observation-based Kalman filter PROFIBUS Process field bus QoS Quality of service RARP Reverse address resolution protocol RMSEs Root mean square errors RTCP RTP control protocol RTP Real-time transport protocol RTT Round-trip time STCP Stream control transmission protocol SNRP Simple network robot protocol TCP Transmission control protocol TEAR TCP emulation at receivers TICP Transparent inter-process communication UDP User datagram protocol VINT Virtual internetwork test VPN Virtual private network vii Chapter Conclusion Though NRS is a young field of robotics, it has been actively employed in industry, medicine, education, services, and many other applications In Vietnam, NRS has gained the research interest in recent years and is expecting to yield new way of interaction to deal with urgent problems such as transportation and surveillance This thesis studies some fundamental problems of NRS including the localization, stability control, and navigation The goal is to realize new and effective algorithms contributing to the development of NRSs In order to achieve the goal, the system model is first defined and formulated The network is modeled as a module between the process and controller which delivers input signals and observation measurements with possible delay, loss, and out-of-order The delay is assumed to be random, but measurable at each sampling time; the out-of-order is considered as a long delay; and the packet loss is modeled as a binary random variable From those assumptions, a discrete time-varying statespace model of the NRS has been derived and employed as basis for the development of algorithms A real NRS system has been developed to serve experiments It consists of a mobile robot connected to a remote controller via the Internet The robot is the type with two wheels and differential drive It contains basic components for sensing and navigation including drive motors for motion control, sonar ranging sensors for obstacle avoidance, compass and GPS sensors for heading and global positioning, and laser range finder (LRF) and vision system for mapping and navigation The remote controller contains a joystick as input device and a graphic user interface with con117 trol algorithms running at background The data communications is carried out by a multi-protocol model This model utilizes the TCP for the administrative data, UDP for the control signals, and RTP for the live video The problem of localization is addressed from the optimal filtering approach The Kalman filter’s theory is applied to derive a new filter called past observationbased extended Kalman filter (PO-EKF) This filter combines knowledge of the robot kinematics, network state, and feedback measurements to give an optimal estimate of the robot’s pose A relevance factor that reflects the relevance of past measurement to the present is derived to compensate the influence of network The simulation and experiment results confirms the accuracy and computational efficiency of the filter The stabilization control is investigated based on the combination between the Lyapunov technique and the predictive filter First, the Lyapunov stability theory is employed to derive control laws that stabilizes the non-networked robot system Those control laws are then extended to the NRS by implementing a predictive filter between the sensor and controller The filter compensates the influence of the network to acquire an accurate estimate of the system state and consequently ensures the convergence of the control laws The structure of filter includes the PO-EKF plus a time-based extrapolated phase Simulations and experiments were implemented to verify the validity of the control scheme Finally, the results of the localization and stabilization control are integrated into a behavior-based model to deal with the navigation problem The model divides a complex task into individual behaviors Each behavior deals with a different aspect of the network and environment A supervision layer is used to handle the coordination between behaviors It determines the priorities of behaviors based on sensory inputs and then blends their output to give a final decision Simulations and experiments were conducted to validate the applicability of the proposed approach 118 Main contributions The main contributions of this study are as follows: • Development of a unified state-space representation of the NRS under the influence of network delay, message loss, and out-of-order delivery This representation has been adopted to deal with fundamental problems of NRSs A real NRS was developed as the platform for experiments and evaluations A multiprotocol model was proposed for the data communications between components of the NRS The model utilizes advantages of individual transport protocols in delivering certain types of communications data to enhance the communications performance These results were published in [1, 2, 3, 4, 5, 10] • A new optimal filter namely the PO-EKF was proposed for the problem of state estimation and localization of NRSs The filter can deal with the mixed uncertainties of network delay, message loss, and out-of-order delivery The optimality of the filter in term of minimizing the mean square error was theoretically proven The expansion of the filter to non-linear NRSs was derived A number of simulations, comparisons, and experiments were conducted The results confirmed the accuracy, computational efficiency, and implemental capability of the filter These results were published in [12, 13] • A control algorithm to stabilize the NRS was proposed It basically based on the approach in [88], but a new predictive filter was introduced to improve the accuracy and extend the functionality of the controller to deal with not only the network induced delay but also the message loss and out-of-order These results were published in [8, 9] • Development of a behavior-based navigation model to navigate the networked robot in unknown environments Fuzzy logic was employed to increase the adaptation of system to the network Simulations and experiments in various 119 environments proved the efficiency of the proposed model These results were published in [6, 7, 11] Future works Though this study presents significant results on NRSs, expanding those results to systems with multi networked robots would be an interesting problem In this configuration, sensory information does not assist specific robots but shares among them The localization and control algorithms need abilities to handle the heterogeneous data supplied from different sources with the synchronization and sampling mismatches The algorithms also have to be scalable to work with the partial rather than the complete set of information An initial approach for this problem could the development of a sensor fusion algorithm using multiple sampling rate 120 List of Publications Related to This Thesis Trần Quang Vinh, Phùng Mạnh Dương, Trần Hiếu (2005), “Giám sát điều khiển robot di động qua mạng LAN vô tuyến Internet”, Tạp chí khoa học Tự nhiên Cơng nghệ, Đại học Quốc gia Hà Nội, Tập 21, số 2, tr.85-91 Trần Quang Vinh, Vũ Tuấn Anh, Phùng Mạnh Dương, Trần Hiếu (2006), “Xây dựng robot di động dẫn đường cảm biến siêu âm cảm biến ảnh toàn phương”, Hội nghị Cơ điện tử toàn quốc lần thứ (VCM), tr.153-160 Manh Duong Phung, Quang Vinh Tran, Kok Kiong Tan (2010), “Transport Protocols for Internet-based Real-time Systems: A Comparative Analysis,” The Third International Conference on Communications and Electronics (ICCE) Phùng Mạnh Dương, Quách Công Hoàng, Vũ Xuân Quang, Trần Quang Vinh (2010), “Điều khiển robot di động qua mạng Internet sử dụng kiến trúc truyền thông CORBA”, The International Conference on Engineering Mechanics and Automation (ICEMA), pp.232-237 Trần Quang Vinh, Phạm Mạnh Thắng, Phùng Mạnh Dương (2010), “Mạng thông tin điều khiển hệ thống tự động hóa tịa nhà”, Tạp chí Khoa học Tự nhiên Công nghệ, Đại học Quốc gia Hà Nội, Tập 26, số 2, tr.129-140 Manh Duong Phung, Thanh Van Thi Nguyen, Cong Hoang Quach, Quang Vinh Tran (2010), “Development of a Tele-guidance System with Fuzzy-based Secondary Controller”, The 11th IEEE International Conference on Control, Automation, Robotics and Vision (ICARCV), pp.1826-1830 Manh Duong Phung, Thanh Van Thi Nguyen, Tran Quang Vinh (2011), “Control of an Internet-based Robot System Using Fuzzy Logic”, The 2011 IEICE International Conference on Integrated Circuits and Devices in Vietnam (ICDV), pp.98-101 Phùng Mạnh Dương, Nguyễn Thị Thanh Vân, Trần Thuận Hoàng, Trần Quang Vinh (2012), “Điểu khiển ổn định robot di động phân tán qua mạng máy tính 121 dụng lọc dự đoán với quan sát khứ”, Hội nghị Cơ điện tử Toàn quốc lần thứ (VCM), tr.778-786 T H Hoang, P M Duong, N V Tinh, T Q Vinh (2012), “A Path Following Algorithm for Wheeled Mobile Robot Using Extended Kalman Filter”, The 3rd IEICE International Conference on Integrated Circuits and Devices in Vietnam (ICDV), pp.179-183 10 Manh Duong Phung, Thuan Hoang Tran, Thanh Van Thi Nguyen and Quang Vinh Tran (2012), “Control of Internet-based Robot Systems Using Multi Transport Protocols”, 2012 IEEE International Conference on Control, Automation and Information Sciences (ICCAIS), pp.294-299 11 P M Duong, T T Hoang, N T T Van, D A Viet and T Q Vinh (2012), “A Novel Platform for Internet-based Mobile Robot Systems”, The 7th IEEE Conference on Industrial Electronics and Applications (ICIEA), pp.1969-1974 12 Manh Duong Phung, Thi Thanh Van Nguyen, Thuan Hoang Tran, and Quang Vinh Tran (2013), “Localization of Networked Robot Systems Subject to Random Delay and Packet Loss”, The 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp.1442-1447 13 Manh Duong Phung, Thi Thanh Van Nguyen, Thuan Hoang Tran, Quang Vinh Tran (2013), “Localization of Internet-based Mobile Robot”, Tạp chí Khoa học Tự nhiên Công nghệ, Đại học Quốc gia Hà Nội, Tập 29, số 1, tr 1-13 122 References Vietnamese Tu Diep Cong Thanh (2010), “Nghiên cứu điều khiển Tele-Manipulator”, The 5th Vietnam Conference on Mechatronics (VCM-2010), pp 258–264 English Aicardi M., Casalino G., Bicchi A., Balestrino A (1995), “Closed loop steering of unicycle-like vehicles via Lyapunov techniques”, IEEE Robotics & Automation Magazine, vol (1), pp 27–35 AlYahmedi A S., El-Tahir E., Pervez T (2009), “Behavior based control of a robotic based navigation aid for the blind”, Control and Applications Conference, pp 192–212 Amata J., Monferrerb A., Batllec J., Cufi X (1999), “GARBI: a low-cost underwater vehicle”, Journal of Microprocessors and Microsystems, vol 23 (2), pp 61–67 Arkin R C (1987), “Towards Cosmopolitan Robots: Intelligent Navigation in Extended Manmade”, PhD Thesis, University of Massachusetts, Department of Computer and Information Science Arkin R C (1989), “Motor schema-based mobile robot navigation”, The International Journal of Robotics Research, vol (4), pp 92–112 Arkin R C., Balch T (1997), “AuRA: Principles and Practice in Review”, Journal of Experimental and Theoretical Artificial Intelligence(JETAI), vol 9(2-3), pp 175–188 Aude E., Carneiro G., Serdeira H., Silveira J., Martins M., Lopes E (1999), “CONTROLAB MUFA: a multi-level fusion architecture for intelligent naviga- 123 tion of a telerobot”, 1999 IEEE International Conference on Robotics and Automation, pp 465–472 Betke M., Gurvits L (1997), “Mobile robot localization using landmarks”, IEEE Transactions on Robotics and Automation, vol 13(2), pp 251–263 10 Bishop G., Welch G (2001), An Introduction to the Kalman Filter, SIGGRAPH 2001, ACM, Los Angeles, USA 11 Brockett R W (1983), Asymptotic Stability and Feedback Stabilization, Differential Geometric Control Theory, Birkhauser, Boston, pp 181–191 12 Brooks R A (1986), “A Robust Layered Control System for a Mobile Robot”, IEEE Journal of Robotics and Automation, vol (1), pp 14–23 13 Brooks R A (1989), “A Robot that Walks; Emergent Behavior from a Carefully Evolved Network”, IEEE International Conference on Robotics and Automation, Scottsdale, USA, pp 292–296 14 Cavusoglu M C., Tendick F., Cohn M., Sastry S S (1999), “A Laparoscopic Telesurgical Workstation”, IEEE Transactions on Robotics and Automation, vol 15 (4), pp 728–739 15 Chaitanya V S., Patro P D., Sarkar P K (2007), “Delay Dependent Stability in the Real Time Control of a Mobile Robot Using Neural Networks”, The 2007 IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp 95–100 16 Chen C., Li T S., Yeh Y., Chang C (2009), “Design and implementation of an adaptive sliding-mode dynamic controller for wheeled mobile robots”, J Mechatronics, vol 19 (2), pp 156–166 17 Ching-Chih T., Chin-Cheng C., Cheng-Kain C., Yi Yu L (2010), “Behaviorbased navigation using heuristic fuzzy kohonen clustering network for mobile service robots”, International Journal of Fuzzy Systems, vol 12 (1), pp 25–32 18 Cho D K., Chun S H., Ahn, J G., Kwon Y S (2009), “A UDP-based protocol for mobile robot control over wireless Internet”, Second International Conference on Robot Communication and Coordination, pp 1–4 124 19 Cox I J (1991), “Blanche-an experiment in guidance and navigation of an autonomous robot vehicle”, IEEE Transactions on Robotics and Automation, vol (2), pp 193–204 20 Devantech Ltd (n.d.), CMPS03 - Compass Module, Retrieved May 16, 2013, from http://www.robot-electronics.co.uk/htm/cmps3tech.htm 21 Devantech Ltd (n.d.), SRF05 - Ultra-Sonic Ranger Technical Specification, Retrieved May 16, 2013, from http://www.robot- electronics.co.uk/htm/srf05tech.htm 22 Fatmi A., Alyahmedi A S., Khriji L., Masmoudi N (2006), “A fuzzy logic based navigation of a mobile robot”, Journal of World academy of science, Engineering and Technology, Vol (22), pp 169–174 23 Forouzan B (2009), TCP/IP Protocol Suite, McGraw-Hill Science / Engineering / Math, New York, USA 24 Gilat A (2010), MATLAB: An Introduction with Applications, Wiley, Hoboken, USA 25 Golberg K., Mascha M (1995), “Desktop teleoperation via the World Wide Web”, The 1995 IEEE International Conference on Robotics and Automation, pp 654–659 26 Goldberg K., Siegwart R (2002), Beyond Webcams: An Introduction to Online Robots, MIT Press, Cambridge, USA 27 Goldberg K., Gentner, S., Sutter C., Wiegley J (2000), “The Mercury Project: A Feasibility Study for Internet Robots”, IEEE Robotics & Automation Magazine, vol (1), pp 35–40 28 Gralla P (2006), How the Internet Works, Que Publishing, Indianapolis, USA 29 Guo C., Tarn T., Xi N., Bejczy A (1995), “Fusion of human and machine intelligence for telerobotic systems”, 1995 IEEE International Conference on Robotics and Automation, pp 3110–3115 125 30 Han K.H., Kim S., Yong-Jae K., Kim J.H (2001), “Internet Control Architecture for Internet-Based Personal Robot”, Journal of Autonomous Robots, vol 10 (2), pp 135–147 31 Han K.H., Kim Y.J., Kim J.H., Hsia S (2002), “Internet control of personal robot between KAIST and UC Davis”, IEEE International Conference on Robotics and Automation, pp 2184–2189 32 Hermann R., Krener A.J (1977), “Nonlinear Controllability and Observability”, IEEE Transactions on Automatic Control, vol 22 (5), pp 728–740 33 Holux Technology Inc (n.d.), UB-93 Specification, Science-based Industrial Park, Taiwan 34 Hou X., Su J (2004), “A distributed architecture for Internet robot”, IEEE International Conference on Robotics and Automation, pp 3357–3362 35 Hu W., Liu G.P., Rees D (2008), “Networked Predictive Control Over the Internet Using Round-Trip Delay Measurement”, IEEE Transaction on Instrumentation and Measurement, vol 57 (10), pp 2231–2241 36 Huh S., Lee U., Shim H., Park J.B., Noh J.H (2011), “Development of an Unmanned Coal Mining Robot and a Tele-Operation System”, 2011 11th International Conference on Control, Automation and Systems, pp 31–35 37 Hung P D., Trien P M., Vinh T Q (2011), “Multi-robot Searching System in a disaster area using Particle Swarm Optimization Algorithm”, Vietnam Conference on Control and Automation (VCCA 2011), pp 556–559 38 Hwang C.L., Chang L.J (2008), “Internet-Based Smart-Space Navigation of a Car-Like Wheeled Robot Using Fuzzy-Neural Adaptive Control”, IEEE Transactions on Fuzzy Systems, vol 16 (5), pp 1271–1284 39 Issariyakul T., Hossain E (2009), Introduction to Network Simulator NS2, Springer, New York, USA 40 Kim B.M., Tsiotras P (2002), “Controllers for unicycle-type wheeled robots: Theoretical results and experimental validation”, IEEE Transactions on Robotics and Automations, vol 18 (3), pp 294–307 126 41 Kim J.H., Han K.H., Kim S., Kim Y.J (2001), “Internet-Based Personal Robot System using Map-Based Localization”, The 32nd ISR(International Symposium on Robotics, pp 1282–1287 42 Kosuge K., Murayama H (1997), “Bilateral feedback control of telemanipulator via computer network in discrete time domain”, 1997 IEEE International Conference on Robotics and Automation, pp 2219–2224 43 Kruglinski D., Shepherd G., Wingo S (1998), Programming Microsoft Visual C++, Microsoft Press, Redmond, USA 44 Liu P., Meng M., Ye X., Gu, J (2002), “An UDP-based protocol for Internet robots”, The 4th World Congress on Intelligent Control and Automation, pp 59– 65 45 Liu P., Meng M.H., Hu C., Sheng J (2003), “A Modular Structure for Intemet Mobile Robots”, 2003 IEEE/RSJ International Intelligent Robots and Systems, pp 1111–1116 46 Liu P., Meng M.H., Liu P., Yang S X (2005), “An end-to-end transmission architecture for the remote control of robots over IP networks”, IEEE/ASME Transactions on Mechatronics, vol 10 (5), pp 560–570 47 Luck R., Ray A (1990), “An observer-based compensator for distributed delays”, Journal of Automatica, vol 26 (5), pp 903–908 48 Luo R.C., Chen, T.M (2000), “Development of a multi-behavior based mobile robot for remote supervisory control through the Internet”, IEEE/ASME Transaction on Mechatronics, vol (4), pp 376–385 49 Luo R.C., Chern M.Y., Hwang K.S., Liu A., Chen T.M., Hu C.Y., Chen C.C (1998), “Development of intelligent electrical wheelchair for hospital automation”, IEEE/ASME Int Conf Mechatronics (ICMT’98), pp 417–422 50 Luo R.C., Shen S.H., Su K.L., Chang T.C (2002), “Remote mobile security system using personal digital assistant (PDA) for security robot”, The IEEE/ASME Int Conf Advanced Manufacturing Technologies and Education in the 21st Century, pp 181–189 127 51 Luo R.C., Su K.L., Chou J.H., Phang S.H (2001), “Multisensor based control of pet robot through the Internet”, 27th Annu.Conf IEEE Industrial Electronics Society (IECON2001), pp 416–421 52 Ma J., Sun S (2011), “Optimal Linear Estimators for Systems With Random Sensor Delays, Multiple Packet Dropouts and Uncertain Observations”, IEEE Transactions on Signal Processing, vol 59 (11), pp 5181–5192 53 Masuda K., Kimura E., Tateishi N., Ishihara K (2001), “Three dimensional motion mechanism of ultrasound probe and its application for tele-echography system”, The 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 1112–1115 54 Moayedi M., Foo Y.K., Soh Y.C (2010), “Adaptive Kalman Filtering in Networked Systems With Random Sensor Delays, Multiple Packet Dropouts and Missing Measurements”, IEEE Transactions on Signal Processing, vol 58 (3), pp 1577–1588 55 Nielsen C.W., Goodrich M.A., Ricks R.W (2007), “Ecological Interfaces for Improving Mobile Robot Teleoperation”, IEEE Transactions on Robotics, vol 23 (5), pp 927–941 56 Perkins C (2003), RTP: Audio and Video for the Internet, Addison-Wesley Professional, Indianapolis, USA 57 Postel, J (1980) User Datagram Protocol RFC 768, The Internet Engineering Task Force (IETF), Fremont, USA 58 Postel J (1981) Transmission Control Protocol RFC 793, The Internet Engineering Task Force (IETF), Fremont, USA 59 Qin X., Jiang B., Deng X., Zu X., Du Y., Li H (2008), “A robot remote control system based on VPN and TCP/IP protocol”, IEEE International Conference on Mechatronics and Automation, pp 285 – 289 60 Rhee I., Ozdemir V., Yi Y (2000), TEAR: TCP Emulation at receivers: Flow control for multimedia streaming, Department of Computer Science, NCSU, Raleigh, USA 128 61 Roscha O J., Schillinga K., Roth H (2002), “Haptic interfaces for the remote control of mobile robots”, Journal of Control Engineering Practice, vol 10 (11), pp 1309–1313 62 Sanfeliu A., Hagita N., Saffiotti A (2008), “Network robot systems”, Journal of Robotics and Autonomous Systems, vol 56 (10), pp 793–797 63 Sayers C (1998), Remote Control Robotics, Springer Verlag, New York, USA 64 Schenato L (2008), “Optimal Estimation in Networked Control Systems Subject to Random Delay and Packet Drop”, IEEE Transactions on Automatic Control, vol 53 (5), pp 1311–1317 65 Schenker P.S., Baumgartner E.T., Backes P.G., Aghazarian H., Dorsky L., Norris J.S., Squyres S.W (2001), “FIDO: A Field integrated design and operations rover for Mars surface exploration”, Int Symp Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS), pp 1311–1317 66 Schulzrinne H., Casner S., Frederick R., Jacobson V (1996), RTP: A Transport Protocol for Real-Time Applications, RFC 1889, The Internet Engineering Task Force (IETF), Fremont, USA 67 Se S., Lowe D., Little J (2002), “Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks”, Int J Robotics Research, vol 21 (8), pp 735–758 68 SICK AG Waldkirch (2006), Technical description: LMS200/211/221/291 Laser Measurement Systems, Reute, Germany 69 Siegwart R., Nourbakhsh I R (2004), Introduction to Autonomous Mobile Robots, MIT Press, Cambridge, USA 70 Simon D (2006), Optimal State Estimation: Kalman, H infinity, and Nonlinear Approaches, John Wiley & Sons, New York, USA 71 Sinopoli B., Schenato L., Franceschetti M., Poolla K., Jordan M.I., Sastry S.S (2004), “Kalman Filtering With Intermittent Observations”, IEEE Transactions on Automatic Control, vol 49 (9), pp 1453–1464 129 72 Smith C., Jensfelt P (2010), “A predictor for operator input for time-delayed teleoperation”, Journal of Mechatronics, vol 20 (7), pp 778–786 73 Spurgeon C.E (2000), Ethernet: The Definitive Guide, O'Reilly Media, Massachusetts, USA 74 Sugimoto M., Kagotani G., Nii H., Shiroma N., Inami M., Matsuno F (2005), “Time Follower's Vision: a teleoperation interface with past images”, IEEE Computer Graphics and Applications, vol 25 (1), pp 54–63 75 Sundaresan S., Donato W d., Feamster N (2011), “Broadband Internet Performance: A View From the Gateway”, SIGCOMM’11, pp 134–145 76 Taylor K., Dalton B (1997), “Issues in Internet telerobotics”, International Conference on Field and Service Robotics, pp 151–157 77 Teslic L., Skrjanc I., Klancar G (2011), “EKF-Based Localization of aWheeled Mobile Robot in Structured Environments”, J Intelligent Robot System, vol 62 (2), pp 187–203 78 Thanh T.T., Vinh D.Q (2011), “Application of Home Automation for Home Healthcare”, Vietnam Conference on Control and Automation (VCCA-2011), pp 818–822 79 Thomas G.B., Finney R.L (1995), Calculus and Analytic Geometry, 9th edition, Addison Wesley, Massachusetts, USA 80 Thrun E., Fox D., Burgard W., Dellaert F (2001), “Robust Monte Carlo localization for mobilerobots”, J Artificial Intelligence, vol 128 (1-2), pp 99–141 81 Thrun S., Bennewitz M., Burgard W., Cremers A.B., Dellaert F., Fox,D., Schulz D (1999), “MINERVA: A second-generation museum tour-guide robot”, IEEE Int Conf Robotics and Automation, pp 1999–2005 82 Tzafestas C.S., Palaiologou N., Alifragis M (2006), “Virtual and Remote Robotic Laboratory: Comparative Experimental Evaluation”, IEEE Transaction on Education, 49(3), pp 360–369 83 Verhappen I (2005) Foundation Fieldbus ISA-Instrumentation, Systems, and Automation, Durham, USA 130 84 Voss W (2005), A Comprehensible Guide to Controller Area Network, Copperhill Media Corporation, Greenfield, USA 85 Wang C., Zhang X.T., Sun H.J., Meng Q.H., Schilling K (2005), “Haptic Interface of Mobile Robot with Delay Time via Internet”, 2005 International Conference on Machine Learning and Cybernetics, pp 461–466 86 Wang D., Yi J., Zhao D., Yang G (2007), “Teleoperation System of the Internetbased Omnidirectional Mobile Robot with A Mounted Manipulator”, The 2007 IEEE International Conference on Mechatronics and Automation, pp 1799– 1804 87 Wang M., Liu J.N (2005), “Interactive control for Internet-based mobile robot teleoperation”, Journal of Robotics and Autonomous Systems, vol 52 (2-3), pp 160–179 88 Wargui M., Tayebi A., Tadjine M., Rachid A (1997), “On the stability of an autonomous mobile robot subject to network induced delay”, The 1997 IEEE International Conference on Control Applications, pp 28–30 89 Xi N., Tarn T (2000), “Stability analysis of non-time referenced Internet-based telerobotic systems”, Journal of Robotics and Autonomous Systems, vol 32 (23), pp 173–178 131 ... NATIONAL UNIVERSITY, HANOI -VNU UNIVERSITY OF ENGINEERING AND TECHNOLOGY Phung Manh Duong STUDY ON SUPERVISION AND CONTROL OF ROBOT OVER COMPUTER NETWORK Major: Electronic... networked robots This section reviews studies on the localization, stabilization control, and navigation which are topics covered in this thesis 1.3.1 Study of NRSs on localization Localization is... the overall system to be unstable 10 1.3.3 Study of NRSs on navigation Robot navigation includes different interrelated activities such as perception, localization, cognition, and motion control