Electronically Recording MeetingSeminarLecture Minutes by Bada Phones

SAMSUNG ELECTRONICS Restricted Use Only Model Design and Development Report of Project Electronically Recording Meeting/Seminar/Lecture Minutes by Bada Phones Principal Investigator: Tien Pham Email: tienpv-fet@mail.hut.edu.vn Hanoi, April, 2012 1 SAMSUNG ELECTRONICS Restricted Use Only Contents 1. PROJECT DESCRIPTION 4 INTRODUCTION 4 SYSTEM OVERVIEW 4 TECHNICAL SPECIFICATIONS AND FEATURES 5 2. PROGRESS SUMMARY 6 3. EVOLUTION OF RESEARCH AND DEVELOPMENT WORK 7 3.1RECORDING 9 3.2ANNOTATION AND MARKING 9 3.3PLAYBACK UTILITY 10 3.4 CONTENT MODIFICATION 11 3.1MINUTE MERGING 13 3.2PC TOOL FOR MINUTE COMPILATION 15 4. CONCLUSION REMARKS 17 2 SAMSUNG ELECTRONICS Restricted Use Only List of Figures FIGURE 1-1 SYSTEM LAYOUT (WITH SAMPLE AN EVENT SERIES OVER THE TIME) 5 FIGURE 3-2 RESEARCH AND DEVELOPMENT WORKFLOW EVOLUTION 8 FIGURE 3-3 DEVELOPMENT TASKS OF RECORDING AND MARKING FUNCTION 9 FIGURE 3-4 DEVELOPMENT TASKS OF ANNOTATION AND MARKING 9 FIGURE 3-5 DEVELOPMENT TASKS OF PLAYBACK UTILITY 10 FIGURE 3-6: PROCESS OF PLAYBACK FUNCTION 11 FIGURE 3-7 DEVELOPMENT TASKS OF CONTENT MODIFICATION FUNCTION 12 FIGURE 3-8: FINITE STATE MACHINE OF CONTENT MODIFICATION FUNCTION 12 FIGURE 3-9: FINITE STATE MACHINE OF SEARCH FUNCTION 13 FIGURE 3-10: FINITE STATE MACHINE OF SEARCH PROCESS 13 FIGURE 3-11 DEVELOPMENT TASKS OF MINUTE MERGING FUNCTION 14 FIGURE 3-12: MERGING FUNCTION BETWEEN DEVICE1 AND DEVIECE2 14 FIGURE 3-13: DEVELOPMENT TASKS OF PC TOOL FOR MINUTE COMPILATION 15 FIGURE 3-14: PC SOFTWARE ARCHITECTURE DIAGRAM 15 FIGURE 3-15: DATA FLOW IN A PROJECT 17 3 SAMSUNG ELECTRONICS Restricted Use Only 1. Project Description Introduction In modern days, people frequently work in group. They hold seminars, meetings, debates… almost every day. Students attend class lectures even more regularly. It would be great convenient if they were given mobile software tools to record minutes of such events on their mobile phone (in a way that they like). The recorded data include audio, video, photo captured during the meeting occurrence. Furthermore, an attendee with a Bada phone may add annotations as well as mark remarkable events during the meeting. Later on, the user may easily play back, store, convert, and manipulate the content. As the attendee has added text annotations during the meeting, users may search media chunks associated with a particular speaker, a topic, a key word, etc. System overview In this proposal, we are to build a mobile software utility for creating, playing back, and maintaining minutes of meetings, seminars, class lectures, etc. The software targets both professional shorthand secretaries and ordinary attendees (students, staff workers, customers, stock holders, etc). The phone allows the user not only to record video, audio, photos but also to add annotation comments, links to available documents (local files, websites, etc). The recorded data are stored in term of multimedia database for enabling query, search, and retrieval as well as re-editing. 4 SAMSUNG ELECTRONICS Restricted Use Only Figure 1-1 System layout (with sample an event series over the time) Technical Specifications and Features The developed mobile software should have the following capabilities: - Creation and setting up multimedia minutes of meetings, seminars, class lectures, debates, conferences, etc. - Basic features available on the phone (video/audio recording, photo capture) are integrated for the attendee to record conveniently. - The attendee may add text annotations during the recording process. - The attendee may mark remarkable events during the meeting. - At remarkable events, the attendee may create links to local files or websites. - Recorded data are organized into a multimedia database to enable rich maintenance functions. - After recording, mobile users may search/retrieve data chunks of interest (according to speaker, topic, keyword, etc). - Playback of recorded multimedia databases 5 SAMSUNG ELECTRONICS Restricted Use Only - Group sharing (thanks to standardized presentation of recorded data): exchange, storage, modification, etc. 2. Progress summary Respecting the project proposals and SEC technician’s requests, we have reached the following point: - Completion of model design and analysis - Completion of development of a few modules - On the way to completion of remaining modules - Partially completion of module test cases and optimization Basically, we are on-time and keep to the proposed schedule. Some development steps are even ahead of plan. Table 1 presents the development workload in details. Table 1 Development progress and plan Task ID Task name complete time start finish 1 Brainstorming and system design 100% 101 days 4/1/2011 8:00 8/19/2011 17:00 1.1 Installation and setup 100% 7 days 4/1/2011 8:00 4/11/2011 17:00 1.2 Self-training 100% 10 days 4/10/2011 8:00 4/22/2011 17:00 1.3 Model design 100% 60 days 4/20/2011 8:00 7/12/2011 17:00 1.4 Model analysis 100% 30 days 7/1/2011 8:00 8/11/2011 17:00 1.5 Behavioral description 100% 30 days 7/10/2011 8:00 8/19/2011 17:00 2 Module development 100% 116 days 4/29/2011 8:00 10/7/2011 17:00 2.1 Minute recording 100% 45 days 4/29/2011 8:00 6/30/2011 17:00 2.2 Annotation and marking 100% 60 days 5/31/2011 8:00 8/22/2011 17:00 2.3 Playback utility 100% 50 days 6/1/2011 8:00 8/9/2011 17:00 2.4 Content modification 100% 70 days 7/4/2011 8:00 10/7/2011 17:00 6 SAMSUNG ELECTRONICS Restricted Use Only 2.5 Minute merging 100% 60 days 7/1/2011 8:00 9/22/2011 17:00 2.6 PC tool for minute compilation 100% 60 days 9/1/2011 8:00 11/29/2011 17:00 3 Module integration and UI improvement 100% 37 days 10/25/2011 8:00 12/14/2011 17:00 3.1 Module integration 100% 15 days 10/25/2011 8:00 11/14/2011 17:00 3.2 UI improvement 100% 22 days 11/15/2011 8:00 12/14/2011 17:00 4 Deployment of test cases 100% 83 days 8/22/2011 8:00 12/14/2011 17:00 4.1 Module testing 100% 80 days 8/22/2011 8:00 12/9/2011 17:00 4.2 System testing 100% 20 days 11/17/2011 8:00 12/14/2011 17:00 5 Optimization 100% 60 days 10/3/2011 8:00 12/23/2011 17:00 5.1 Computation and communication aspects 100% 50 days 10/17/2011 8:00 12/23/2011 17:00 5.2 Storage aspects 100% 60 days 10/3/2011 8:00 12/23/2011 17:00 6 Documentation completion 100% 30 days 11/17/2011 8:00 12/28/2011 17:00 6.1 Design and development documents 100% 20 days 11/30/2011 8:00 12/27/2011 17:00 6.2 Source code documents/Doxygen 100% 20 days 11/30/2011 8:00 12/27/2011 17:00 6.3 Test case reports 100% 30 days 11/17/2011 8:00 12/28/2011 17:00 3. Evolution of research and development work Figure 3-1 illustrates our work development evolution, showing what we have done and future work. There are basically six parallel workflows, presented by the five pipelines: recording, annotation and marking, playback utility, content modification and minute merging 7 SAMSUNG ELECTRONICS Restricted Use Only Figure 3-2 Research and development workflow evolution 8 SAMSUNG ELECTRONICS Restricted Use Only The workflows in Figure 3-1 involve main development activities as presented in the following subsection. In each development activity, we describe the functions, followed by development results in term of test cases. 3.1 Recording Figure 3-2 zooms in the development flow related to the recording function. Figure 3-3 Development tasks of Recording and marking function When the user starts Recording module, he/she will see a list of all projects. This includes functions for Recording video or audio and capture image during the evolution of the meeting/conference, lecture, seminar, etc. We are to integrate these functions into an organized human-machine interface. 3.2 Annotation and marking Figure 3-5 zooms in the development flow related to the functions matching text annotation with videos and marking remarkable events during recording. Figure 3-4 Development tasks of annotation and marking 9 SAMSUNG ELECTRONICS Restricted Use Only It is important that, during the recording process, the attendee may want to add annotation comments or mark a special event, such as voices of the boss, presentation of critical documents, explanation of difficult math, etc. We are to develop a multithreading program that allows the attendee to add such annotations and marks during recording the meeting minutes. The utility must be able to correlate the added comments to recorded media. To help people who don’t use Latin language as Korean, Japanese or Chinese, we attach keypad of Bada API support . 3.3 Playback utility This utility allows the user to search and playback all video/audio clip, text annotation, hyperlink, etc. The below Figure shows the tasks which must be done to develop this utility. Figure 3-5 Development tasks of Playback utility It is obviously necessary to build a tool for the user to play back the recorded minutes. We intend to build a playback toolset for mobile users to replay the whole content as well as the selected chunk. 10 [...]... tasks of Content modification function Data structure of Project: - In a Meeting, there are many segments which are known as minutes - After recording any meeting, the user can store it in video chunks - For each video chunk, the user can remark event and add annotation while recording Moreover, it is possible to edit them while playing back - Information of a video concludes the date time, content,... will be displayed and the user can view these websites When the user reviews the content of meeting, a list of the presenters in that meeting will be shown The user can review a video recording what those speakers talked by clicking on that list 3.4 Content modification The utility Minute/project Editor allows the user delete video, audio, modify text annotation, add/remove links to local docs and web... Modification function: - Allowing the user to compose and modify the content Namely, it can delete and modify information of Project such as Project name, Minutes Name, text The application allows the user to modify the saved content of the meeting by Edit function He/she may also delete, or add more comments after the meeting • Function of searching (Query): The user can retrieve interested data chunks... Finite State Machine of Search function The application allows the user to search a segment of video in term of speakers and meeting name, minutes name, etc Figure 3-10: Finite State Machine of Search Process 3.1 Minute merging This utility allows the user to open many minutes at the same time Besides, this utility can also match text annotation with video/audio clip and add more links to text annotation... PC Then, the user can watch, edit and text note on PC Figure 3-14: PC software architecture diagram We wrote the application C# on PC It has the following features: + Display the name of projects, the minutes and the links of video on treeview 15 SAMSUNG ELECTRONICS Restricted Use Only + Click node on treeview to play file mp4, flv, wav… + Like media player, our program can adjust volume; rewind a section... file on treeview as delete file We used to click right mouse and used ContextMenuStrip in application c# 16 SAMSUNG ELECTRONICS Restricted Use Only This is the Figure of program managing XML database by programming language C#, which is a part of development of this application on PC The XML files are extracted from cell-phone The program has some functions such as analyzing, browsing, which extracting . 8:00 8 /19 /2 011 17 :00 1. 1 Installation and setup 10 0% 7 days 4 /1/ 2 011 8:00 4 /11 /2 011 17 :00 1. 2 Self-training 10 0% 10 days 4 /10 /2 011 8:00 4/22/2 011 17 :00 1. 3 Model design 10 0% 60 days 4/20/2 011 . integration 10 0% 15 days 10 /25/2 011 8:00 11 /14 /2 011 17 :00 3.2 UI improvement 10 0% 22 days 11 /15 /2 011 8:00 12 /14 /2 011 17 :00 4 Deployment of test cases 10 0% 83 days 8/22/2 011 8:00 12 /14 /2 011 17 :00 4 .1. 8:00 7 /12 /2 011 17 :00 1. 4 Model analysis 10 0% 30 days 7 /1/ 2 011 8:00 8 /11 /2 011 17 :00 1. 5 Behavioral description 10 0% 30 days 7 /10 /2 011 8:00 8 /19 /2 011 17 :00 2 Module development 10 0% 11 6 days 4/29/2 011