Distributed optimisation in wireless sensor networks a hierarchical learning approachs

... known as Temporal-Difference (TD) Learning, e.g Q -learning (Watkins and Dayan, 1992) Watkins and Dayan’s Q -learning is based on Q-functions rather than value functions, 17 CHAPTER STOCHASTIC PLANNING ... domain To date, it has found applications in a variety of areas: target tracking (Evans et al., 2005), sensor networks applications (Yeow et al., 11 CHAPTER STOCHASTIC PLANNING Fi...

Ngày tải lên: 12/09/2015, 08:20

... to a source and carry the information concurrently to the destination in order to achieve load balancing and rapid delivery of the information In a wireless sensor network, both single paths and ... reveals a gain which increases with the reduction of the play-back delay Note however that while multipath routing may result in playback delay gain, increasing the path...

Ngày tải lên: 21/06/2014, 17:20

... Non-cooperative game Co-operative game Complete information game Game of strategy and chance Dynamic (sequential) game Static (Simultaneouse) game Figure 1: Classification of games Superframe-1 Active ... collision and less idle waiting time in backoff procedure In “Incomplete Game , access delay performance is far better than “NM”, and comparable with “IBM”, as it can easily ada...

Ngày tải lên: 21/06/2014, 17:20

... Locator Sensor Attacker S3 L5 L2 Locator Sensor Attacker (a) (b) Figure 1: The attack scenarios in WSN (a) Attacker model in range-based localization; (b) Attacked locators with temporal and spatial ... and Z Wang, A secure localization approach against wormhole attacks using distance consistency,” EURASIP Journal on Wireless Communications and Networking, vol 2010, 11 pages...

Ngày tải lên: 21/06/2014, 11:20

... S Boyd, and S Lall, “A scheme for robust distributed sensor fusion based on average consensus, ” in Proceedings of the 4th International Symposium on Information Processing in Sensor Networks ... failure, and other practical conditions when utilizing the DAC algorithm in wireless sensor networks References [1] R Olfati-Saber, J A Fax, and R M Murray, Consensus...

Ngày tải lên: 21/06/2014, 16:20

... scheme, differing only in the fact that multiple keys are used to establish pairwise key instead of just one By increasing the amount of key overlap required for key establishment, this scheme increases ... Generating Key Pool The initial key pool consists of L key groups and each key group consists of M initial keys Hence, the initial key pool contains P = L ∗ M initial k...

Ngày tải lên: 21/06/2014, 17:20

... frequency-asynchronous networks is a challenging task and is left for future work DISTRIBUTED TIME SYNCHRONIZATION AS COUPLED DISCRETE -TIME PLLs The purpose of this section is to discuss the distributed synchronization ... baseband signal received by the kth node in the nth time period reads (sampling index m ranges within −N/2 < m ≤ N/2 with m = corresponding to the firi...

Ngày tải lên: 22/06/2014, 19:20

... containing two event-regions as shown in Figure We have μn (1) = for those sensors {n} in the rectangle event-region, and μn (1) = 0.8 for those sensors {n} in the circular event-region In our ... training data in capturing the true field In practice, the training data should have a good representation of the true field, for example, the number of event-regions and their correspo...

Ngày tải lên: 22/06/2014, 19:20

... Communication intensive Large data amounts in high frequency One per rescuer in mountain area WINS for military [22] Military Target identification, realtime, security, quality of data Large data amounts, ... QoS-aware middleware requires a more powerful platform than the other two A database approach is taken in sensor information and networking architecture (SINA) [24], in Ti...

Ngày tải lên: 23/06/2014, 00:20

... monitoring/viewing live data 39 and other more complex data analysis, and backs the data up to a database In this framework, the data management systems database is the primary backup while the gateways database ... the gateway system which is in charge of receiving data from the sink, doing any preliminary processing necessary, storing the data to a local database, and fo...

Ngày tải lên: 24/08/2014, 12:25

... In Chapter 5, the decision making protocols for winner determination in reverse auction- based task allocation are introduced Our proposed Energy and Delay Efficient Distributed Winner Determination ... centralized winner determination method The task message format for centralize method is {Task, Task Size, Task Deadline} where Task can be any low-level tasks such as s...

Ngày tải lên: 30/09/2015, 14:23

... Multi- agent Learning 2.1 CHAPTER: Multi- agent Learning A possible approach to multi- agent learning is to regard the MAS as a large single agent whose state and action spaces are the concatenation of ... the MAXQ approach to multi- agent RL The main idea of [52] is to take advantage of the hierarchy approach and enable communication at high level tasks only Eac...

Ngày tải lên: 26/11/2015, 13:03

... The types of topologies used for sensor networks include star, mesh, star-mesh etc [2] In Wireless sensor networks there are two kinds of wireless nodes; sensor and base station nodes The main ... ensuring that the LEAP protocol is able to handle all three scenarios aforementioned, the LEAP protocol will be improved in terms of security for WSNs I used the...

Ngày tải lên: 05/03/2014, 23:20

... simplicity III THE RELIABLE TRANSPORT PROBLEM IN WSN In the preceding discussions, we introduced the notion of event-to-sink reliability in WSN and pointed out the inapplicability of existing transport ... AKYILDIZ: EVENT-TO-SINK RELIABLE TRANSPORT IN WIRELESS SENSOR NETWORKS 1009 soon as possible We can achieve such an aggressive increase by invoking the fact that...

Ngày tải lên: 16/03/2014, 19:20

... Decentralized estimation over orthogonal multipleaccess fading channels in wireless sensor networks— optimal and suboptimal estimators Xin Wang∗1 and Chenyang Yang1 School of Electronics and ... Abstract We study optimal and suboptimal decentralized estimators in wireless sensor networks over orthogonal multipleaccess fading channels in this...

Ngày tải lên: 18/06/2014, 22:20