پایان نامه دستیابی به کیفیت سرویس در شبکه های حسگر بیسیم با استفاده از آتوماتا های یادگیر سلولی

فهرست:

چکیده 9

1-  مقدمه. 10

1-1-   شبکه های حسگر بی سیم.. 10

1-1-1-   مسائل مطرح در شبکه های حسگر بی سیم.. 13

1-1-2-   پوشش محیط در شبکه های حسگر بی سیم.. 15

1-1-3-   خوشه بندی در شبکه های حسگر بی سیم.. 16

1-1-4-   تجمیع داده ها در شبکه های حسگر. 17

1-2-   کیفیت سرویس در شبکه های حسگر بی سیم.. 18

1-2-1-   کیفیت سرویس در شبکه های داده ای سنتی... 20

1-2-2-   کیفیت سرویس در شبکه های حسگر بی سیم.. 26

1-3-  آتوماتای یادگیر. 29

1-3-1-   آتوماتای یادگیر. 31

1-3-2-   معیار‌های رفتار اتوماتای یادگیر. 34

1-3-3-   الگوریتمهای یادگیری... 35

1-3-4-   آتوماتای یادگیر با عملهای متغیر. 39

1-4-   آتوماتای یادگیر سلولی.. 40

1-4-1-   آتوماتای سلولی... 40

1-4-2-   آتوماتای یادگیر سلولی (CLA). 44

1-4-3-   آتوماتای یادگیر سلولی نامنظم (ICLA). 47

1-5-   اهداف پایان نامه و ساختار آن.. 48

2-  پوشش محیط در شبکه های حسگر بی سیم با استفاده از آتوماتاهای یادگیرسلولی   50

2-1-   مقدمه                      50

2-1-1-   اشکال مختلف طراحی... 51

2-2-  دسته بندی مسائل پوشش در شبکه های حسگر. 52

2-2-1-   پوشش ناحیه ای... 53

2-2-2-   پوشش نقطه ای    56

2-2-3-   پوشش مرزی    57

2-3-  روش پوشش CCP.. 59

2-3-1-   فرضیات مسئله.. 59

2-3-2-   تشریح روش      59

2-4-  حل مسئله پوشش(k-پوششی ) با استفاده از آتوماتاهای یادگیر. 61

2-4-1-   فرضیات و مدل مسئله.. 63

2-4-2-   روش تشخیص افزونه بودن نود حسگر. 64

2-4-3-   شبیه سازی      72

2-5-  جمع بندی        79

3-  خوشه بندی در شبکه های حسگر بی سیم با استفاده از آتوماتاهای یادگیر سلولی   80

3-1-  مقدمه                      80

3-2-  کارهای انجام شده. 83

3-2-1-   پروتکل خوشه بندی LEACH.. 85

3-2-2-   پروتکل خوشه بندی HEED.. 88

3-3- خوشه بندی در شبکه های حسگر بی سیم با استفاده از آتوماتاهای یادگیر سلولی.. 93

3-3-1-   روش خوشه بندی پیشنهادی... 94

3-3-2-   شبیه سازی        102

3-4-  جمع بندی        107

4-  تجمیع داده ها در شبکه های حسگر با استفاده از آتوماتاهای یادگیر. 108

4-1-   مقدمه                      108

4-2-  کارهای انجام گرفته. 109

4-3-  تجمیع داده ها در شبکه های حسگر با استفاده از آتوماتاهای یادگیر. 112

4-3-1-   بیان مسئله و مفروضات آن.. 113

4-3-2-   تشریح روش پیشنهادی... 115

4-4-  شبیه سازی      119

4-4-1-   آزمایش اول      122

4-4-2-   آزمایش دوم      122

4-4-3-   آزمایش سوم    123

4-5-  جمع بندی        125

5-  نتیجه گیری.. 126

6-  پیوست اول: شبکه های حسگر بی سیم.. 127

6-1-   تاریخچه شبکه های حسگر. 127

6-2-  ساختار هر گره حسگر. 128

6-2-1-   اجزاء درونی یک گره حسگر. 128

6-2-2-   محدودیتهای سختافزاری یک گره حسگر. 130

6-3-  پشته پروتکلی   131

6-4-  مزایای شبکه های حسگر بیسیم.. 132

6-5-  کاربردهای شبکه های حسگر بیسیم.. 134

7-  پیوست دوم:آتوماتای یادگیرسلولی.. 138

7-1-   تاریخچه آتوماتای یادگیر. 138

7-2-  معیار‌های رفتار اتوماتای یادگیر. 139

7-3-  آتوماتای یادگیر با عملهای متغیر. 141

7-4-  آتوماتای یادگیر تعقیبی.. 142

7-5-  آتوماتای یادگیر سلولی (CLA). 150

7-6-  آتوماتای یادگیر سلولی باز(OCLA). 151

7-7-  آتوماتای یادگیر سلولی ناهمگام (ACLA). 152

8-  پیوست سوم: شرح نرم افزار J-Sim و پیاده سازی الگوریتمهای پیشنهادی با آن   155

8-1-  مقدمه                      155

8-2-  شبیه ساز J-Sim   158

8-2-1-   شبیه سازی شبکه های حسگر بی سیم با استفاده از J-sim... 158

8-2-2-   نصب و اجرا          162

8-3- پیاده سازی الگوریتم خوشه بندی پیشنهادی.. 163

8-4-  پیاده سازی الگوریتم پوشش پیشنهادی.. 185

8-5-  پیاده سازی الگوریتم تجمیع پیشنهادی.. 190

9-  واژه نامه. 195

مراجع. 199

منبع:

[1]   Akyildiz I. F., Su W., Sankarasubramaniam Y. and Cayircl E., “A survey on sensor networks”, in: Proceedings of the IEEE Communication Magazine, Vol. 40, pp. 102-114, August 2002.

[2]  Ilyas M. and Mahgoub I., "Handbook of Sensor Networks: Compact Wireless and Wired Sensing Systems", in: Proceedings of the CRC Press, London, Washington, D.C., 2005.

[3]  Kahn J.M., Katz R.H. and Pister K.S.J., “Next century challenges: mobile networking for smart dust”, in: Proceedings of the ACM MobiCom 99, Washington, USA, pp. 271–278,1999.

[4]  D. Chen and K. Varshney, “QoS Support in Wireless Sensor Networks: A Survey” Department of EECS, Syracuse University Syracuse, NY, U.S.A 13244, 2004

[5]  A. Ganz, Z. Ganz, and K. Wongthavarawat, Multimedia Wireless Networks:Technologies, Standards, and QoS , Prentice Hall, Upper SaddleRiver, NJ, 2004.

[6]  E. Crawley et al., “A Framework for QoS-Based Routing in the Internet, ” RFC 2386, http://www.ietf.org/rfc/rfc.2386.txt, Aug. 1998.

[7]  Z. Demetrios, “A Glance at Quality of Services in Mobile Ad-Hoc Networks, ” http://www.cs.ucr.edu/ csyiazti/cs260.html, November 2001.

[8]  D. Zeinalipour, S. Aristeidou, S. Kazeli, “IP Quality of Services (in Greek), ” http://www.cs.ucr.edu/ csyiazti/downloads/papers/ipqos/ papers/ip-qos.pdf, 1999

[9]  K. Wui, J. Harms, “QoS Support in Mobile Ad Hoc Networks, ” Crossing Boundaries – an interdisciplinary Journal, Vol 1, No 1, Fall 2001.

[10] S. Chakrabarti and A. Mishra, “QoS Issues in Ad Hoc Wireless Networks, ” IEEE Communications Magazine, pp. 142-148, February 2001.

[11] S. Meguerdichian, F. Koushanfar, M. Potkonjak, and M. B. Srivastava, “Coverage Problems in Wireless Ad-hoc Sensor Networks, ” in proceedings of IEEE Infocom, 2001, pp. 1380-1387

[12] S. Meguerdichian, F. Koushanfar, G. Qu, and M. Potkonjak, “Exposure in Wireless Ad-hoc Sensor Networks, ” in Mobile Computing and Networking, 2001, pp. 139-150.

[13] R. Iyer and L. Kleinrock, “QoS Control for Sensor Networks, ” in ICC 2003, May 2003.

[14] S. Tilak, N. Abu-Ghazaleh and W. Heinzelman, “A taxonomy of wireless micro-sensor network communication models, ” ACM Mobile Computing and Communication Review(MC2R), June 2002.

[15] Narendra K. S., Thathachar M. A. L.; "Learning automata: An introduction"; Prentice Hall, 1989.

[16] Narendra K.S., Thathachar M. A. L. "Learning automata a survey"; IEEE Transactions on Systems, Man and Cybernetics, vol. 4, no. 4, July 1974.

[17] Mance, E., and Stephanie, S., H., "Reinforcement learning: A tutorial," Wright Laboratory, 1996.

[18] Sutton, R. S., and Barto, A.G.; "Reinforcement learning: Introduction"; MIT Press, 1998.

[19] Lakshmivarahan S., Thathachar M. A. L.; "Absolutely expedient learning algorithms for stochastic automata"; IEEE Transactions on Systems, Man and Cybernetics, vol. 6, pp. 281-286, 1973.

[20] Mars, P., Chen, J. R., and Nambiar, R., Learning algorithms theory and applications in signal processing, control and communications, CRC Press, 1996.

[21] Lakshmivarahan S.; "Learning algorithms: theory and applications"; New York: Springer-Verlag, 1981.

[22] Lakshmivarahan S., Thathachar M. A. L.; "Optimal non-linear reinforcement schemes for stochastic automata"; Information Science, vol. 4, pp. 121-128, 1982.

[23] Lakshmivarahan S., Thathachar M. A. L.; "Absolute expediency of Q and S-model learning algorithm"; IEEE Transactions on Systems, Man and Cybernetics, vol. 6, pp. 222-226, 1976.

[24] Viswanathan R., Narendra K. S.; "Expedient and optimal variable structure stochastic automata"; Technical report CT-31, Dunham Lab., Yale University, New Haven, Connecticut, U.S.A., April 1970.

[25] Mason L.G.; "An optimal learning algorithm for s-model environments"; IEEE Transactions on Automatic Control, pp. 493-496, October 1973.

[26] Thathachar M. A. L., Bhaskar R. H.; "Learning automata with changing number of actions"; IEEE Transactions on Systems, Man and Cybernetics, vol. 17, no. 6, November 1987.

[27] Meybodi M. R., Beigy H., Taherkhani M.; "Cellular Learning Automata and Its Applications"; Journal of Science and Technology, University of Sharif, No. 25, pp.54-77, Autumn/Winter 2003-2004.

[28] Meybodi M. R., Kharazmi M. R.; "Cellular Learning Automata and Its Application to Image Processing"; Journal of Amirkabir, Vol. 14, No. 56A, pp. 1101-1126, 2004.

[29] Meybodi M. R, Kharazmi M. R., "Image Restoration Using Cellular Learning Automata", in Proceedings of the Second Iranian Conference on Machine Vision, Image Processing and Applications, Tehran, Iran, pp. 261-270, 2003.

[30] Meybodi M. R., Khojaste M. R., "Application of Cellular Learning Automata in Modeling of Commerce Networks", in Proceedings of 6th Annual International Computer Society of Iran Computer Conference CSICC2001, Isfahan, Iran, pp. 284-295, 2001.

[31] Meybodi M. R., Mehdipour F., "VLSI Placement Using Cellular Learning Automata", in Proceedings of 8th Annual International Computer Society of Iran Computer Conference CSICC2001, Mashhad, Iran, pp. 195-203, 2003.

[32] Meybodi, M. R., and Taherkhani, M., "Application of Cellular Learning Automata to Modeling of Rumor Diffusion", in Proceedings of 9th Conference on Electrical Engineering, Power and Water institute of Technology, Tehran, Iran, pp. 102-110, May 2001.

[33] Beigy H., Meybodi M. R.; "A Mathematical Framework for Cellular Learning Automata"; Advances on Complex Systems, Vol. 7, No. 3, pp. 1-25, 2004.

[34] V. Raghunathan, C. Schurgers, S. Park, and M. B. Srivastava, “Energy-Aware Wireless MicrosensorNetworks,” IEEE Signal Processing Magazine, Vol 19, pp 40-50, March 2002.

[35] M. Cardei and J. Wu “Coverage inWireless Sensor Networks” Department of Computer Science and Engineering Florida Atlantic University Boca Raton, FL 33431, 2004.

[36] S. Slijepcevic and M. Potkonjak, “Power Efficient Organization of Wireless Sensor Networks,” Proc. of IEEE International Conference on Communications, Vol 2, pp 472-476,Helsinki, Finland, June 2001.

[37] M. Cardei, D. MacCallum, X. Cheng, M. Min, X. Jia, D. Li, and D.-Z. Du, “Wireless Sensor Networks with Energy Efficient Organization”, Journal of Interconnection Networks, Vol 3, No 3-4, pp 213-229, Dec 2002.

[38] D. Tian and N. D. Georganas, “A Coverage-Preserving Node Scheduling Scheme for Large Wireless Sensor Networks,” Proc. of the 1st ACM Workshop on Wireless Sensor Networks and Applications, 2002.

[39] W. R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, “Energy-Efficient Communication Protocols for Wireless Microsensor Networks,” Proc. of HICSS, Jan 2000.

[40] F. Ye, G. Zhong, S. Lu, and L. Zhang, “Energy Efficient Robust Sensing Coverage in Large Sensor Networks,” Technical Report UCLA, 2002.

[41] C.-F. Huang and Y.-C. Tseng. The coverage problem in a wireless sensor network. In ACM International Workshop on Wireless Sensor Networks and Applications (WSNA), 2003, pp. 115–121.

[42] M. Cardei and D.-Z. Du, “ImprovingWireless Sensor Network Lifetime through Power Aware Organization”, accepted to appear in ACM Wireless Networks.

[43] S. Meguerdichian, F. Koushanfar, M. Potkonjak, and M. Srivastava, “Coverage Problems in Wireless Ad-Hoc Sensor Networks,” IEEE Infocom 2001, Vol 3, pp 1380-1387, April 2001.

[44] G. Xing, X. Wang, Y. Zhang, C. Lu, R. Pless, and C. Gill, “Integrated coverage and connectivity configuration for energy conservation insensor networks,” ACM Transactions on Sensor Networks, vol. 1, no. 1,pp. 36–72, August 2005.

[45] Crossbow Technology, Inc., http://www.xbow.com/Products/Product_pdf_files /Wireless_pdf/6020-0042-01_A_MICA2.pdf.

[46] A. R. Shahani, D. K. Schaeffer, T. H. Lee, ”A 12 mW Wide Dynamic Range CMOS Front-End for a portable GPS Receiver”, Digest of Technical Papers, IEEE International Solid State Circuits Conference, Vol. 40, pp. 368-369, February 1997.

[47] S. Capkun, M. Hamdi, J. P. Hubaux, ”GPS-free Positioning in Mobile Ad-hoc Networks”, Proceedings of the 34th Annual Hawaii International Conference on System Sciences (HICSS-34), January 3-6, 2001.

[48] D. Niculescu, B. Nath, ”Ad Hoc Positioning System (APS)”, IEEE Global Telecommunications Conference 2001, Vol. 5 , pp. 2926-2931, November 2001.

[49]  C. Savarese , K. Langendoen, J. Rabaey, ”Robust Positioning Algorithms for Distributed Ad-hoc Wireless Sensor Networks”, Proceedings of the 2002 USENIX Annual Technical Conference, Monterey, pp. 317-27, June 2002.

[50] D. Perkins, R. Tumati, ”Reducing Localization Errors in Sensor AdhocNetworks”, 23rd IEEE International Conference on Performance, Computing and Communications, Phoenix, pp. 723 - 729, April 2004.

[51] ] T. Yan, T. He, J. A. Stankovic, ” Differentiated Surveillance for Sensor Networks” SenSys’03, November 5–7, 2003, Los Angeles, California, USA.

[52] D. Tian and N. Georganas, “A coverage-preserving node scheduling scheme for large wireless sensor networks,” in Proc. of First ACM International Workshop on Wireless Sensor Networks and Applications, Atlanta, GA, September 2002, pp. 32–41.

[53] F. Ye, G. Zhong, J. Cheng, S. Lu, and L. Zhang, “Peas: A robust energy conserving protocol for long-lived sensor networks,” in Proc. of International Conference on Distributed Computing Systems (ICDCS’03),Providence, RI, May 2003, pp. 28–37.

[54] O. Younis and S. Fahmy, "Distributed Clustering in Ad-hoc Sensor Networks: A Hybrid, Energy-Efficient Approach", In Proc. of IEEE INFOCOM, volume 1, pp. 629-640, March 2004.

[55] W.Heinzelman, A. Chandrakasan, and H. Balakrishnan, Energy efficient Communication Protocol for wireless microsensor networks, Proc of Hawaii conference on System Science, Jan 2000.

[56] Seema Bandopadhyay, Edward J.Coyle, An Energy efficient hierarchical clustering algorithm for wireless sensor networks, Proc. of IEEE INFOCOM 2003, San Francisco, CA.

[57] Srejan Raghuwanshi and Amitabh Mishra, A Self adpative clustering based algorithm for increased energy efficiency and scalability in WSN,Proc. IEEE VTC 2000.

[58] Gaurav Gupta, Mohammed Younis, Load balanced clustering in wireless sensor networks, proc of IEEE ICC 2003.

[59] Li Chunwang, Chung Wei Wang, A cross layer design of clustering architecture for WSN, Proc. of IEEE ICNSC, 2004 Taipei, Taiwan.

[60] Ewa Hansen, Jonas Neander, Mikael Nolin, Mats Bjorkman; Efficient Cluster Formation for Sensor Networks, MRTC report ISSN 1404-3041 ISRN MDH-MRTC-199/2006-1-SE, M?lardalen Real-Time ResearchCentre, M?lardalen University.

[61] S. Basagni, “Distributed Clustering Algorithm for Ad-hoc Networks,” in International Symposium on Parallel Architectures, Algorithms, and Networks (I-SPAN), 1999.

[62] S. Banerjee and S. Khuller, “A Clustering Scheme for Hierarchical Control in Multi-hop Wireless Networks,” in Proceedings of IEEE INFOCOM, April 2001.

[63] M. Gerla, T. J. Kwon, and G. Pei, “On Demand Routing in Large Ad Hoc Wireless Networks with Passive Clustering,” in Proceeding of WCNC,2000.

[64] C. R. Lin and M. Gerla, “Adaptive Clustering for Mobile Wireless Networks,” in IEEE J. Select. Areas Commun., September 1997.

[65] W. R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, “An Application-Specific Protocol Architecture for Wireless MicrosensorNetworks,” IEEE Transactions on Wireless Communications, vol. 1,no. 4, pp. 660–670, October 2002.

[66] S. Bandyopadhyay and E. Coyle, “An Energy-Efficient HierarchicalClustering Algorithm for Wireless Sensor Networks,” in Proceedingsof IEEE INFOCOM, April 2003.

[67] D. Estrin, R. Govindan, J. Heidemann, and S. Kumar, “Next Century Challenges: Scalable Coordination in Sensor Networks,” in Proceedings of the ACM/IEEE International Conference on Mobile Computing and Networking (MOBICOM), August 1999.

[68] H. Chan and A. Perrig, “ACE: An Emergent Algorithm for Highly Uniform Cluster Formation,” in Proceedings of the First European Workshop on Sensor Networks (EWSN), January 2004.

[69] V. Mhatre and C. Rosenberg, “Design Guidelines for Wireless Sensor Networks Communication: Clustering and Aggregation,” Ad-hoc Networks ournal, 2004.

[70] J. Kulik, W. R. Heinzelman, and H. Balakrishnan, “Negotiation-Based Protocols for Disseminating Information in Wireless Sensor Networks,” ACM Wireless Networks, vol. 8, no. 2-3, pp. 169–185, 2002. [Online]. Available: citeseer.nj.nec.com/kulik99negotiationbased.html

[71] M. Esnaashari, M. R. Meybodi, “Irregular Cellular Learning Automata and Its Application to Clustering in Sensor Networks” ICEE, 2007

[72] Farajzadeh, N. and Meybodi, M. R., "Learning Automata-based Clustering Algorithm for Sensor Networks", Proceedings of 12th Annual CSI Computer Conference of Iran, Shahid Beheshti University, Tehran, Iran, pp. 780-787, Feb. 20-22, 2007

[73] Esnaashari, M. and Meybodi, M. R., "A Cellular Learning Automata based Clustering Algorithm for Wireless Sensor Networks", Sensor Letters, 2008, to appear

[74] M. Ilyas, I. Mahgoub, "Handbook of Sensor Networks : Compact Wireless and Wired Sensing Systems", CRC Press, London, Washington, D.C., 2005.

[75] K. Akkaya, M. Younis, "A Survey on Routing Protocols for Wireless Sensor Networks", Elsevier Ad Hoc Network Journal, pp. 325-349, 2005.

[76] R. Shah and J. Rabaey, "Energy Aware Routing for Low Energy Ad Hoc Sensor Networks", in Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), Orlando, Florida, March 2002.

[77] Y. Xu, W. C. Lee, J. Xu, and G. Mitchell, "Processing Window Queries in Wireless Sensor Networks", IEEE International Conference on Data Engineering (ICDE'06), Atlanta, GA, April 2006.

[78] R. Rosemark and W. C. Lee, "Decentralizing Query Processing in Sensor Networks", the Second International Conference on Mobile and Ubiquitous Systems: Networking and Services (Mobiquitous'05), San Diego, CA, July, 2005, pp. 270-280.

[79] J. Winter, Y. Xu, and W. C. Lee, "Energy Efficient Processing of K Nearest Neighbor Queries in Locationaware Sensor Networks", the Second International Conference on Mobile and Ubiquitous Systems: Networking and Services (Mobiquitous'05), San Diego,CA, July, 2005, pp. 281-292.

[80] G. Bontempi and Y. Le Borgne, “An adaptive modular approach to the mining of sensor network data”, Workshop on Data Mining in Sensor Networks, SIAM SDM, Newport Beach, CA, USA, April 2005.

[81] C. Liu, K. Wu, and J. Pei, "A Dynamic Clustering and Scheduling Approach to Energy Saving in Data Collection from Wireless Sensor Networks", In Proceedings of the Second Annual IEEE Communications Society Conference on Sensor and AdHoc Communications and Networks (SECON'05), Santa Clara, California, USA, September, 2005.

[82] O. Younis and S, Fahmy, "An Experimental Study of Routing and Data Aggregation in Sensor Networks", In Proceedings of the International Workshop on Localized Communication and Topology Protocols for Ad hoc Networks (LOCAN), held in conjunction with The 2nd IEEE International Conference on Mobile Ad Hoc and Sensor Systems (MASS-2005), November 2005.

[83] R. Virrankoski and A. Savvides, “TASC : Topology Adaptive Spatial Clustering for Sensor Networks”, Second IEEE Intl. Conf. on Mobile Ad Hoc and Sensor systems", Washington, DC, November, 2005.

[84] S. Soro and W. Heinzelman, "Prolonging the Lifetime of Wireless Sensor Networks via Unequal Clustering," Proceedings of the 5th International Workshop on Algorithms for Wireless, Mobile, Ad Hoc and Sensor Networks (IEEE WMAN '05), April 2005.

[85] M. Lotfinezhad and B. Liang, “Effect of partially correlated data on clustering in wireless sensor networks,” in Proceedings of the IEEE International Conference on Sensor and Ad hoc Communications and Networks (SECON), Santa Clara, California, October 2004.

[86] C. Guestrin, P. Bodik, R. Thibaux, M. Paskin and S. Madden, “Distributed Regression : An Efficient Framework for Modeling Sensor Network Data”, Intel corporation, 2004.

[87] K. Dasgupta, K. Kalpakis and P. Namjoshi, “An Efficient Clustering-based Heuristic for Data Gathering and Aggregation in Sensor Networks”, IEEE Wireless Communications and Networking Conference, Vol.4, No. 1, March, 2003.

[88] J. Beaver, M. A. Sharaf, A. Labrinidis, and P. K. Chrysanthis, “Location-Aware Routing for Data Aggregation in Sensor Networks”, Proc. of the 2nd Hellenic Data Management Symposium, 2003.

[89] P. Radivojac, U. Korad, K. M. Sivalingam and Z. Obradovic, "Learning from Class-Imbalanced Data in Wireless Sensor Networks," IEEE Semiannual Vehicular Technology Conference, VTC-Fall 2003, Vol. 5, pp. 3030-3034, Orlando, Florida, U.S.A., October 2003.

[90] B. Karp and H. Kung. Greedy perimeter stateless routing for wireless networks. In Proceedings of the Sixth Annual ACM/IEEE International Conference on Mobile Computing and Networking (MobiCom 2000), pages 243–254, Boston, MA, August 2000.

[91] P. Beyens, M. Peeters, K. Steenhaut and A. Nowe, "Routing with Compression in Wireless Sensor Networks: a Q-learning Approach", In "Fifth European Workshop on Adaptive Agents and Multi-Agent Systems (AAMAS 05), Paris, France.", 2005.

[92] M. Esnaashari, M. R. Meybod, “A Learning Automata Based Data Aggregation Method for Sensor Networks”, CSICC 2007

[93] Nishimura C. E. and Conlon D. M., "IUSS Dual Use: Monitoring Whales and Earthquakes Using SOSUS", in: Proceedings of the Mar. Tech., Soc. Journal, Vol. 27, No. 4, pp. 13-21, 1994.

[94] http://www.pmel.noaa.gov/vents/acoustics/sosus.html

[95] Al-Karaki J. N. and Kamal A. E., ”Routing techniques in wireless sensor networks: a survey”. in: Proceedings of the IEEE Wireless Communications, Vol. 11, pp. 6-28, 2004.

[96] Janakiram D., Venkateswarlu R. and Nitin S., ”A survey on programming languages, middleware and applications in wireless sensor networks”, in: Proceedings of the IITM-CSE-DOS-2005-04, 2005.

[97] Janakiram D., Venkateswarlu R. and Nitin S., ”A survey on programming languages, middleware and applications in wireless sensor networks”, in: Proceedings of the IITM-CSE-DOS-2005-04, 2005.

[98] Tsypkin Ya. Z.; "Adaptation and learning in automatic systems"; New York: Academic Press, 1971.

[99] Tsetlin, M. L., Automaton theory and modeling of biological systems, New York: Academic Press, 1973.

[100]   Narendra K.S., Viswanathan R.; "Learning models using stochastic automata"; Proceedings of International Conference of Cybernetics and Society, Washington DC, October 1972.

[101]   Varshavski V. I., Vorontsova I.P.; "On the behavior of stochastic automata with variable structure"; Avtomatika & Telemechanika, vol. 24, pp. 353-360, 1963.

[102]   Fu K. S., McMurtry G. J.; "An application of stochastic automata to the synthesis learning systems"; Technical Report TR-EE 65-17,Purdue       University, 1965.

[103]   Fu K. S., Li T. J.; "Formulation of learning automata and automata games"; Information Science, vol. 1, no. 3, pp. 237-256, 1969.

[104]   Fu K. S., Li T. J.; "On stochastic automata and languages"; Information Science, vol. 1, no. 4, pp. 403-419, 1969.

[105]   Fu K. S.; "Stochastic automata as models of learning systems"; in Computer and Information Sciences II, Ed. Lou J.T., New York: Academic Press, 1967.

[106]   McLaren R. W.; "A stochastic automaton model for synthesis of learning systems"; IEEE Transactions on System Science and Cybernetics, vol. 2, pp. 109-114, 1966.

[107]   Chandrasekharan B., Shen D. W. C.; "On expediency and convergence in variable structure stochastic automata"; IEEE Transactions on System Science and Cybernetics, vol. 5, pp. 145-149, 1968.

[108]   Najim K., Poznyak A. S.; editors, "Learning automata: theory and application", Tarrytown, New York: Elsevier Science Publishing Ltd., 1994.

[109]   Oommen B. J., Ma D. Y."Deterministic learning automata solutions to equipartioning problem"; IEEE Transactions on Computers, vol. 37, pp. 2-14, January 1988.

[110]   Oommen, B. J., Croix St., de E. V.; "String taxonomy using learning automata"; IEEE Transactions on Systems, Man and Cybernetics, vol. 27, pp. 354-365,       April 1997.

[111]   Oommen, B. J., Croix St., de E. V.; "Graph partitioning using learning automata"; IEEE Transactions on Computers, vol. 45, no. 2, pp. 195-208, 1996.

[112]   Tsoularis A., Kambhampati C., Warwick K.; "Path planning of robots in noisy workspaces using learning automata"; Proceedings of the IEEE International Symposium of Intelligent Control, Chicago, 1993.

[113]   Gilbert V., Thibault J., Najim K.; "Learning automata for the control and optimization of a continuous stirred tank fermenter"; IFAC Symposium on Adaptive Systems in Control and Signal Processing, Grenoble, France, July 1992.

[114]   Ikonen E., Najim K.; "Use of learning automata in distributed fuzzy logic processor training"; IEEE Proceedings of Control Theory and Applications, pp. 255-262, 1997.

[115]   Najim K.; "Modeling and self-adjusting control of an absorption column"; International Journal of Adaptive Control and Signal Processing, vol. 5, pp. 335-345, 1991.

[116]   Sequeira J., Bispo C., Sentieiro J.; "Distributed control of a flexible manufacturing plant using learning automata"; Proceedings of the IMACS/IFAC International Symposium on Parallel and Distributed Computing in Engineering Systems, Corfu, Greece, pp.327-332, June 1992.

[117]   Thathachar M. A. L., Bhaskar R. H.; "Learning automata with changing number of actions"; IEEE Transactions on Systems, Man and Cybernetics, vol. 17, no. 6, November 1987.

[118]   Thathachar M. A. L., Sastry P. S.; "A class of rapidly converging algorithms for learning automata"; in Proceeding of IEEE Intersnational Conference on Cybern. Soc., Bombay, India, pp. 602–606, Jan. 1984.

[119]   Thathachar M. A. L., Sastry P. S.; "Estimator algorithms for learning automata"; in Proceeding of Platinum Jubilee Conference on  Systems and Signal Process. Bangalore, India, pp. 29–32, Dec. 1986.

[120]   Oommen B. J. , Lanctôt J. K.; "Discretized pursuit learning automata"; IEEE Transactions on System, Man, Cybernetics, vol. 20, pp. 931–938, July/Aug. 1990.

[121]   Oommen B. J., Agache M.; "Continuous and Discretized Pursuit Learning Schemes: Various Algorithms and Their Comparison"; IEEE Transactions on System, Man, Cybernetics, Part B: Cybernetics, Vol. 31, No. 3, June 2001.

[122]   Beigy H., Meybodi M. R.; "Open Synchronous Cellular Learning Automata"; Technical Report, Soft Computing Laboratory, Computer Engineering Department, Amirkabir University of Technology(Tehran Polytechnic), Tehran, Iran.

[123]   Schönfisch B., Roos A. D.; "Synchronous and Asynchronous updating in cellular automata"; BioSystems, vol 51, p.p. 123-143, 1999.