Map-based Mobile Services Design,Interacton and Usability Phần 5 doc

7 Personalising Map Feature Content for Mobile Map Users 137 2006) files that have been loaded into an Oracle 9i spatial database (Oracle Spatial, 2006). Using vector data allows the map to be divided into distinct layers, where each layer can be further decomposed into individual features. The user has the freedom of browsing mobile maps by executing any of the map actions described in Table 7.1. Looking at Fig. 7.2 we can see the different components of the MAPPER GUI. In Fig. 7.2 the user is presented with a map containing different layers where each layer is categorized as one of the following types: x Full layer – recommended non-landmark layers and landmark layers. For a land- mark layer to be displayed as a full layer, all individual features describing the layer must have a score exceeding the personalisation threshold į. x Partial layer – recommended landmark layer where only a subset of the individual features describing the layer have a score exceeding į. x Empty layer – any layer that is not recommended by the system or any recom- mended landmark layer where no individual features describing that layer have a score exceeding į. Fig. 7.2. MAPPER application GUI 4 As is evident from Fig. 7.2, layers that are displayed as partial layers have a second checkbox beside the layer name in the layers panel. This enables the user to request further detail describing the layer if desired. This action is recorded in the log files along with all other map actions and is taken into consideration when updating the 4 Figures 7.2, 7.5, 7.6, and 7.7 are in color. See accompanying CD-ROM for color versions. 138 Joe WEAKLIAM, David WILSON, Michela BERTOLOTTO user’s profile. If the user wishes to see the names of any features then they simply place the stylus over that feature and the name is displayed at the bottom of the map. In addition to those actions outlined in Table 7.1 we have also implemented several high level spatial queries allowing the user to highlight various aspects of feature con- tent contained in the map. These queries are classified as strong actions and enable further detail related to user map feature preferences to be ascertained. These may be of interest to professionals requiring access to specific aspects of the spatial map data. 7.4.2 Capturing user-map interactions in log files All user-map interactions are captured in log files in XML. Using XML facilitates fast parsing of log files and enables specific session information to be extracted from the files once sessions are terminated. Fig. 7.3 shows an excerpt from a sample log file describing the detail that is captured at the map layer level when the user manually zooms in (z03) on a specific region of the map. As the detail displayed in Fig. 7.3 is captured only at the layer level, no preference information at an individual feature level, irrespective of whether layers involved in the action are landmark layers or oth- erwise, can be ascertained through log file analysis. <useraction> <mapaction> <action_id>z03</action_id> <layer_id>D21</layer_id> <layer_id>D43</layer_id> <layer_id>D61</layer_id> </mapaction> <frame> <frame_number>6</frame_number> <frame_time>1115891528609</frame_time> <frame_boundary>- 105.0215,39.87568,- 105.0215,39.84096,-104.96144,39.87568,- 104.96144,39.84096</frame_boundary> <layer_id>D21</layer_id> <layer_id>D43</layer_id> <layer_id>D61</layer_id> </frame> </useraction> Fig. 7.3. XML excerpt showing map layer level of detail Fig. 7.4 shows a second excerpt displaying what is recorded at the feature level when a user executes a manual zoom in action. For each landmark map layer that ei- ther intersects or lies wholly inside the selected zoom window, the individual features of that layer type that are involved in the action are recorded, e.g. D43 represents schools shown as points on the map. This allows for more detailed analysis of user in- teractions as content preferences at the individual feature level can be established. 7 Personalising Map Feature Content for Mobile Map Users 139 <useraction> <mapaction> <action_id>z03</action_id> <layer_id>D43</layer_id> <layer_id>A11</layer_id> </mapaction> <frame> <frame_number>20</frame_number> <frame_time>1140795217000</frame_time> <frame_boundary>…</frame_boundary> <frame_layer> <layer_id>D43</layer_id> <feature_id>79</feature_id> <feature_id>81</feature_id> </frame_layer> <frame_layer> <layer_id>A11</layer_id> </frame_layer> </frame> </useraction> Fig. 7.4. XML excerpt showing map feature level of detail Each user-map interaction results in the generation of a map frame that has several associated attributes, namely a frame time, frame boundary, and frame layers. Interest map frames are extracted from log files based on time and action criteria where a frame score is calculated for each interest frame. If the time interval between two con- secutive map frames exceeds a specified threshold m, then the first frame is deemed to be an interest frame (m is calculated based on each individual user’s session history). However, there is also an upper bound on the time interval that elapses between suc- cessive frames. If the time interval between two consecutive actions exceeds k (60 seconds), then the first frame is not recorded as an interest frame as it is presumed that the user was interrupted in their current task. At the moment we are working with fixed thresholds, as the current focus is to determine whether map personalization can be achieved and if so, does it benefit map users in any way. The next step is to im- prove the accuracy of the personalization based on each individual MAPPER user, which may involve the incorporation of thresholds with varying values. 7.4.3 Displaying personalisation at the layer and feature levels Personalisation is provided at both the layer and feature level. Non-landmark layers are personalised at the layer level whereas landmark layers can be personalised at the layer and individual feature level. The following section displays maps that are per- sonalised based on the profiles of users who have contrasting content preferences. 140 Joe WEAKLIAM, David WILSON, Michela BERTOLOTTO Fig. 7.5. Map showing layer level personalisation Fig. 7.5 and 7.6 show maps that are personalised at the layer and feature levels re- spectively for a user with children and whose preferences centre on outdoor activities. As a result map layers like parks, lakes, and schools are recommended as map Fig. 7.6. Map showing feature level personalization 7 Personalising Map Feature Content for Mobile Map Users 141 content of interest. Looking at Fig. 7.5 we can see a map region displaying all the parks, lakes, and schools for that region as the map has been personalised at the layer- level. In contrast, Fig. 7.6 displays a map of the same region showing the same land- mark layers personalised at feature level į 1 . As can be seen from Fig. 7.6 there is a notable reduction in the number of schools, parks, and lakes present, as only those in- dividual features with feature scores exceeding į 1 are recommended. Fig. 7.7. Personalised map with high personalisation threshold Fig. 7.7 shows a map personalised at feature level į 2 for a user whose profile de- scribes them as a homemaker with children. į 2 is set very high resulting in only the highest relevance features being returned to the user upon receiving a request for a map. As can be seen from the map the only landmark features present are apartment blocks (visiting friends), hospitals (taking kids to the doctor), shopping centres (shop- ping), and schools (dropping kids to school). It is possible to alter į in order to display more or less detail depending on the preferences of the individual requesting the map. 7.5 Evaluating MAPPER efficiency In previous experiments carried out (Weakliam et al, 2005b) it was shown that per- sonalising map content at the layer level, in a manner similar to the personalisation technique described in this article, assisted the user when completing mapping tasks. Results of the experiments carried out in (Weakliam et al, 2005b) show that users were able to complete tasks with more ease when presented with personalised maps than when presented with non-personlised maps due largely to the recommendation of 142 Joe WEAKLIAM, David WILSON, Michela BERTOLOTTO pertinent map layer content. It was also shown that the recommendations made by the application became more accurate as the number of mapping tasks completed by the participants increased. In conclusion prominent issues linked to both information overload and demands for explicit user input were effectively addressed during the experiment due to the efficiency of the personalisation provided. An experiment was carried out to test the hypothesis that personalising maps at both the layer level and feature level benefits users when using MAPPER. Six partici- pants took part in the experiment. Three of the participants had experience using the application, whereas the other three had not used the application on any previous oc- casions. The three participants who had no experience whatsoever interacting with the application were given a five-minute instruction on how to use the application. Each user was instructed to complete different mapping tasks over a period of one month where each task centered on specific map content. The users had complete freedom to interact with the maps presented to them, using any combination of map browsing ac- tions, but ultimately had to complete the task assigned to them for that session. The maps returned were personalised using preference information extracted from user models, generated from user interaction history recorded from previous sessions. The following displays results that show that personalising maps based on user in- teraction information captured implicitly can benefit users requesting mobile maps due to the considerable reduction in the size of datasets used to render the maps. Fig. 7.8 shows a chart of the various map types presented to the 6 experiment participants vs. the size of the dataset used to render the maps. In Fig. 7.8 NP represents a fully detailed non-personalised map (used as a control), PL represents maps personalised at the layer level based on preference information established from user interaction his- tory, and PF represents maps personalised at both the layer and feature level based also on preference information determined from interaction history. In both PL and PF the number of recommended non-landmark map layers is set to 6, whereas the number of recommended landmark layers is set to 10. For PF į is set to 0.25. 0 50 100 150 200 250 300 350 400 450 NP User 1 User 2 User 3 User 4 User 5 User 6 user map type size of dataset (kb) PL PF Fig. 7.8. Map type vs. size of dataset used to render map 7 Personalising Map Feature Content for Mobile Map Users 143 Looking at Fig. 7.8 a significant decrease in the size of datasets used to render per- sonalised maps both at the layer level and feature level is evident when compared to the non-personlised control. From examining results of the experiment described in (Weakliam et al, 2005b), it is important to note that the number of requests for addi- tional layer content decreased as the number of tasks completed increased. This is primarily due to the fact that as the number of tasks completed increased, the system was able to ascertain user map content preferences more precisely as a result of con- tinuous interaction between users and specific map layers. This has important conse- quences for the generation of personlised maps with MAPPER, as if a user is content with the level of detail presented to them, then the information recommended by the system is indeed accurate and is sufficient for the user to complete their task. This in turn addresses the problems of information overload and mobile device limitations. 7.6 Conclusions and future work Humans encounter problems related to information overload and HCI when interact- ing with maps on mobile devices. When rendering maps on mobile devices develop- ers are faced with several major difficulties, ranging from small screen sizes for map display to limited bandwidth for transmitting map data across wireless networks. In response to these problems we have designed and implemented MAPPER, which is a mobile application that generates personalised maps for users on the move at two dis- tinct levels of detail. All map actions executed by users on the mobile device are cap- tured implicitly and are used to infer user preferences in map feature content. User models are then created and updated dynamically based on user interactions with mo- bile maps. Personalising maps in this manner is extremely useful as it results in a con- siderable reduction in the size of datasets used to render maps on mobile devices. Re- ducing the size of map datasets allows the shortfalls of limited screen size, low computational power, and restricted bandwidth to be addressed and results in faster download times than if presenting users with fully detailed maps. This is paramount when users request maps when on the move. For future work several key areas must be addressed. First of all we are transfer- ring the full functionality of MAPPER to a more portable device than a Tablet PC, i.e. a PDA. We are also looking into improving the functionality available at the interface, e.g. implementing more complex spatial queries for professional users. Finally, more detailed user studies than those outlined in this chapter need to be carried out. This in- cludes both qualitative and quantitative analyses of the system functionality. The im- pacts that further evaluations may have on MAPPER functionality must be assessed in order to improve MAPPER efficiency. References Agrawal, R., Imielinski, T., and Swami, A.N. (1993): Mining association rules between sets of items in large databases. Proceedings of the ACM SIGMOD International Conference on Management of Data, Washington, D.C, pp. 207-216. 144 Joe WEAKLIAM, David WILSON, Michela BERTOLOTTO Fink, J. and Kobsa, A. (2002): User modelling in personalised city tours. Intelligence Review 18(1), pp. 33-74. Fischer, G. (2001): User modeling in human-computer interaction. User Modeling and User- Adapted Interaction 11(1-2), pp. 65-86. Hinze, A. and Voisard A. (2003): Locations- and time-based information delivery in tourism. Proceedings of the 8 th International Symposium on Advances in Spatial and Temporal Da- tabases, Santorini Island, Greece, pp. 489-507. Horvitz, E., Breese, J., Heckerman, D., Hovel, D., and Rommelse, K. (1998): The Lumiere Pro- ject: Bayesian user modelling for inferring the goals and needs of software users. Proceed- ings of the 14 th Conference on Uncertainty in Artificial Intelligence, Madison, Wisconsin, pp. 256-265. Kelly, D. and Belkin, N. (2001): Reading time, scrolling and interaction: Exploring implicit sources of user preferences for relevance feedback during interactive information retrieval. Proceedings of the 24th Annual International Conference on Research and Development in Information Retrieval (SIGIR '01), New Orelans, LA, pp. 408-409. Kelly, D. and Teevan, J. (2003): Implicit feedback for inferring user preference: A bibliogra- phy. SIGIR Forum 37(2), pp. 18-28. Kim, J., Oard, D.W., and Romanik, K. (2001): User modelling for information access based on implicit feedback. Proceedings of the ISKO France Workshop on Information Filtering, Paris, France. Linton, F., Joy, D., and Schaefer, H.P. (1999): Building user and expert models by long-term observation of application usage. Proceedings of the International Conference on User Modelling (UM99), Banff, Canada, pp. 129-138. MapQuest (2006): http://www.mapquest.com/ OpenMap (2006): http://openmap.bbn.com/ Oppermann, R. and Specht, M. (2000): A context-sensitive nomadic information system as an exhibition guide. Proceedings of the Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000), Bristol, UK, pp. 127-142. Oracle Spatial: http://www.oracle.com/technology/software/products/spatial/index.html Reichenbacher, T. (2001a): The world in your pocket – towards a mobile cartography. Pro- ceedings of the 20 th International Cartographic Conference (ICC 2001), Beijing, China, pp. 2514-2521. Reichenbacher, T. (2001b): Adaptive concepts for a mobile cartography. Supplement Journal of Geographical Sciences 11, pp. 43-53. Schmidt-Belz, B., Nick, A., Poslad, S., and Zipf, A. (2002): Personalised and location-based mobile tourism services. Proceedings of Mobile HCI‘02 with the Workshop on “Mobile Tourism Support Systems”, Pisa, Italy. Tiger/Line files (2006): http://www2.census.gov/geo/tiger/tiger2k/ Weakliam, J., Wilson, D., and Bertolotto, M. (2005a): Implicit interaction profiling for recom- mending spatial content. Proceedings of the 14 th International Symposium on Advances in Geographic Information Systems (ACMGIS’05), Bremen, Germany, pp. 285-294. Weakliam, J., Lynch, D.B., Doyle, J., Bertolotto, M., and Wilson, D. (2005b): Delivering per- sonalized context-aware spatial information to mobile devices. Proceedings of the 5 th In- ternational Workshop on Web and Wireless Geographic Information Systems (W2GIS’05), Lausanne, Switzerland, pp. 194-205. Weisenberg, N., Voisard, A., and Gartmann, R. (2004): Using ontologies in personalised mo- bile applications. Proceedings of the 12 th annual ACM international workshop on Geo- graphic Information Systems (ACMGIS’04), Washington DC, pp. 2-11. Yahoo! Maps (2006): http://maps.yahoo.com/ 7 Personalising Map Feature Content for Mobile Map Users 145 Zipf, A. (2002): User-adaptive maps for location-based services (LBS) for tourism. Proceed- ings of the 9th International Conference for Information and Communication Technologies in Tourism (ENTER 2002), Innsbruck, Austria, pp.329-338. Zipf, A. and Richter, K.F. (2002): Using focus maps to ease map reading. Developing smart applications for mobile devices. Künstliche Intelligenz (KI). Special issue: Spatial Cogni- tion (4), pp. 35-37. 8 A Survey of Multimodal Interfaces for Mobile Mapping Applications Julie DOYLE 1 , Michela BERTOLOTTO 1 , David WILSON 2 1 School of Computer Science and Informatics, University College Dublin 2 Department of Software and Information Systems, University of North Carolina at Charlotte Abstract. The user interface is of critical importance in applications providing mapping services. It defines the visualisation and interaction modes for carrying out a variety of mapping tasks, and ease of use is essential to successful user adoption of a mapping application. This is redoubled in a mobile context, where mobile device limitations can hinder usability. In particular, interaction modes such as a pen/stylus are limited and can be quite difficult to use in a mobile con- text. Moreover, the majority of GIS interfaces are inherently complex and re- quire significant user training, which can be a serious problem for novice users such as tourists. We propose an increased focus on developing multimodal in- terfaces for mobile GIS, allowing for two or more modes of input, as an attempt to address interaction complexity in the context of mobile mapping applica- tions. Such interfaces allow users to choose the modes of interaction that are not only most intuitive to them, but also most suitable for their current task and en- vironment. This chapter presents the user interaction problem and the utility of multimodal interfaces for mobile GIS. We describe our multimodal mobile GIS CoMPASS which helps to address the problem by permitting users to interact with spatial data using a combination of speech and gesture input. CoMPASS is set in the context of a representative survey across a range of comparable mul- timodal systems, and the effectiveness of our approach is evaluated in a user study which demonstrates that multimodal interfaces provide more intuitive and efficient interaction for mobile mapping applications. 8.1 Introduction Intuitive Graphical User Interfaces are paramount when developing mobile applica- tions providing map services. The availability and usage of mobile devices has in- creased dramatically in recent years and while mobile device technology has signifi- cantly improved since its beginning, there are still a number of limitations associated with such devices (e.g., small interface footprint, use in motion) which can hinder the usability of mobile mapping applications. Specifically, we are concerned with the lim- ited interaction techniques mobile mapping users face, making it necessary to address human computer interaction challenges associated with mobile device technology when designing mobile geospatial interfaces. Indeed, restricted modes of interaction are a key factor of GIS interface complexity, which is another significant problem with current mobile mapping applications. This chapter advocates the design of [...]... presented in Fig 8 .5 162 Julie DOYLE, Michela BERTOLOTTO, David WILSON 400 350 Time (secs) 300 250 Unimodal input 200 Multimodal input 150 100 50 0 Overall Noisy Quiet Male Female Fig 8 .5 Average interaction speeds for unimodal and multimodal interaction These results show that across all factors, multimodal interaction using speech and pen was significantly faster (p < 0.01), and therefore more efficient... commands Of these 62 .5% , 55 % agreed that with increased usage, interacting multimodally would become easier 164 Julie DOYLE, Michela BERTOLOTTO, David WILSON 8.6 Discussion Within the research realm of mobile interactive mapping applications, multimodal interfaces are a relatively new and exciting concept Such interfaces significantly assist in increasing the flexibility and robustness of mobile GIS and. .. Schomaker, L and Suhm, B (2000): Audio-visual and Multimodal Speech-based Systems In Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation, D Gibbon, I Mertins and R Moore (Eds.), pp 102-203, Kluwer Bertolotto, M and Egenhofer, M (1999): Progressive Vector Transmission In 7th ACM Symposium on Advances in Geographic Information Systems, pp 152 - 157 , Kansas City,... Bertolotto, M and Wilson, D (2005b): Delivering Personalized Context-Aware Spatial Information to Mobile Devices In W2GIS, 5th International Workshop on Web and Wireless Geographic Information Systems, pp 194-2 05, Lausanne, Switzerland 9 User Interaction in Mobile Navigation Applications Kristiina JOKINEN Department of Computer Sciences, University of Tampere Abstract The chapter focuses on cooperation and. .. interactive mobile mapping applications Usability plays a vital role in a user’s acceptance and adoption of a geospatial application To ensure maximum usability, interfaces for such applications should be user friendly, intuitive to both novice and professional users alike and highly interactive However, many GIS interfaces are intrinsically complex and require domain specific knowledge for carrying out map-based. .. they can issue the command “help” to view a list of available commands for interacting (Fig 8.3) Two modes of speech input are available when interacting with the CoMPASS interface – voice commands and dictation 8 A Survey of Multimodal Interfaces for Mobile Mapping Applications 151 Voice commands consist of short phrases made up of one or two words We felt that keeping voice commands short would reduce... will only be carried out if the command associated with the action has been recognised and determined as being a legitimate voice command Fig 8.2 Screenshot of a surveyor creating an annotation (using pen and keyboard) regarding a particular reservoir Voice Commands Currently there are approximately 350 commands that CoMPASS recognises The vast majority of these commands contain a feature name, combined... Journal of Location Based Services Fuhrmann, S., MacEachren, A., Dou, J., Wang, K and Cox, A (20 05) : Gesture and Speechbased Maps to Support Use of GIS for Crisis Management: A User Study In AutoCarto 20 05, Las Vegas, Nevada IBM ViaVoice™ (2006): http://www-306.ibm.com/software/info1/websphere/index.jsp?tab=products/mobilespeech Jost, M., Haussler, J., Merdes, M and Malaka, R (20 05) : Multimodal Interaction... ‘ 05, GIS Research UK, pp 52 4 -52 8, Glasgow, Scotland 166 Julie DOYLE, Michela BERTOLOTTO, David WILSON Malaka, M., Haeussler, J and Hidir, A (2004): SmartKom Mobile – Intelligent Ubiquitous User Interaction In 9th International Conference on Intelligent User Interfaces, pp 310312, Madeira, Portugal Nickel, K and Stiefelhagen, R (2003): Pointing Gesture Recognition based on 3D-tracking of Face, Hands... Springer-Verlag LNCS Wasinger, R., Stahl, C and Kreuger, A (2003b): Robust Speech Interaction through the use of Multiple and Different Media Input Types In Eurospeech 2003, pp 1049-1 052 Weakliam, J., Bertolotto, M and Wilson, D (2005a): Implicit Interaction Profiling for Recommending Spatial Content In ACMGIS ’ 05, pp 2 85- 294, Bremen, Germany 8 A Survey of Multimodal Interfaces for Mobile Mapping Applications 167 . <frame_number>6</frame_number> <frame_time>11 158 9 152 8609</frame_time> <frame_boundary>- 1 05. 02 15, 39.8 756 8,- 1 05. 02 15, 39.84096,-104.96144,39.8 756 8,- 104.96144,39.84096</frame_boundary>. recommended non-landmark map layers is set to 6, whereas the number of recommended landmark layers is set to 10. For PF į is set to 0. 25. 0 50 100 150 200 250 300 350 400 450 NP User 1 User. 11, pp. 43 -53 . Schmidt-Belz, B., Nick, A., Poslad, S., and Zipf, A. (2002): Personalised and location-based mobile tourism services. Proceedings of Mobile HCI‘02 with the Workshop on Mobile Tourism