Q-learning-based Optimization of Smart Home's Wireless Sensors Network Lifetime

ISMAEL JRHILIFA, Hamid Ouadi, Abdelilah Jilbab

Abstract


Abstract— Wireless sensor networks (WSN) have witnessed increased utilization in recent years, particularly with the internet of things (IoT) trend in numerous sectors such as health, agriculture, marine, and smart buildings. The main challenge of these networks is energy efficiency; typically, sensor nodes are powered by tiny batteries with limited capacity. In this research, we suggest a Q-learning-based routing algorithm for optimizing WSN lifespan and sending huge amounts of data in smart home applications. The suggested routing approach takes advantage of the benefits of Q-learning to discover the ideal routing path to transmit data with the least amount of energy dissipation. To mimic the WSN in a smart home environment, the simulation is implemented in 3D. The presented routing method is evaluated in comparison to three different protocols: QLRP, EQL, and Dijkstra. The findings show that the created routing approach surpasses the other protocols in terms of prolonging WSN lifetime, total transferred data, and network energetic cost.


Keywords


WSN, smart home, lifetime optimization, reinforcement learning, Q-learning, routing protocol energy efficiency

Full Text:

PDF

References


Yau, KL.A., Goh, H.G., Chieng, D. et al. Application of reinforcement learning to wireless sensor networks: models and algorithms. Computing 97, 1045–1075 (2015). https://doi.org/10.1007/s00607-014-0438-1.

Yang, SH. (2014). Hardware Design for WSNs. In: Wireless Sensor Networks. Signals and Communication Technology. Springer, London. https://doi.org/10.1007/978-1-4471-5505-8_3

M. U. Younus, M. K. Khan, M. R. Anjum, S. Afridi, Z. A. Arain and A. A. Jamali, "Optimizing the Lifetime of Software Defined Wireless Sensor Network via Reinforcement Learning," in IEEE Access, vol. 9, pp. 259-272, 2021, doi: 10.1109/ACCESS.2020.3046693.

N. Havard, S. McGrath, C. Flanagan and C. MacNamee, "Smart Building Based on Internet of Things Technology," 2018 12th International Conference on Sensing Technology (ICST), 2018, pp. 278-281, doi: 10.1109/ICSensT.2018.8603575.

Mehmood, A.; Lloret, J.; Noman, M.; Song, H. (2015). Improvement of the Wireless Sensor Network Lifetime using LEACH with Vice-Cluster Head. Adhoc and Sensor Wireless Networks. 28(1-2):1-17. http://hdl.handle.net/10251/65889

B. Jang, M. Kim, G. Harerimana and J. W. Kim, "Q-Learning Algorithms: A Comprehensive Classification and Applications," in IEEE Access, vol. 7, pp. 133653-133667, 2019.

I. Jrhilifa, H. Ouadi and A. Jilbab, "Smart home’s wireless sensor networks lifetime optimizing using Q-learning," IECON 2021 – 47th Annual Conference of the IEEE Industrial Electronics Society, 2021, pp. 1-6, doi: 10.1109/IECON48115.2021.9589460.

Yadav, A.K., Sharma, P. & Yadav, R.K. A novel algorithm for wireless sensor network routing protocols based on reinforcement learning. Int J Syst Assur Eng Manag 13, 1198–1204 (2022). https://doi.org/10.1007/s13198-021-01414-2

Vially Kazadi Mutombo, Sung Y. Shin, and Jiman Hong. 2021. EBR-RL: energy balancing routing protocol based on reinforcement learning for WSN. In Proceedings of the 36th Annual ACM Symposium on Applied Computing (SAC '21). Association for Computing Machinery, New York, NY, USA, 1915–1920. https://doi.org/10.1145/3412841.3442063

M. Krishnan and Y. Lim, “Reinforcement learning-based dynamic routing using mobile sink for data collection in WSNs and IoT applications,” Journal of Network and Computer Applications, vol. 194, no. Complete, p. Nov. 2021.

Guo W, Yan C, Lu T. "Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing." International Journal of Distributed Sensor Networks. February 2019.

C. Gomez and J. Paradells, "Wireless home automation networks: A survey of architectures and technologies," in IEEE Communications Magazine, vol. 48, no. 6, pp. 92-101, June 2010, doi: 10.1109/MCOM.2010.5473869.

B. Abidi, A. Jilbab, M. EL Haziti, "Optimization of Energy Consumption with the Gateway Nodes in Wireless Sensor Netwoks", International Journal of Sensor Wireless Communications and Control, vol. 7, no. 2, 152-160, 1 August 2017.

E. Longo, A. E. C. Redondi, M. Cesana, A. Arcia-Moret and P. Manzoni, "MQTT-ST: a Spanning Tree Protocol for Distributed MQTT Brokers," ICC 2020 - 2020 IEEE International Conference on Communications (ICC), 2020, pp. 1-6, doi: 10.1109/ICC40277.2020.9149046.

T. Hu and Y. Fei, "QELAR: A Machine-Learning-Based Adaptive Routing Protocol for Energy-Efficient and Lifetime-Extended Underwater Sensor Networks," in IEEE Transactions on Mobile Computing, vol. 9, no. 6, pp. 796-809, June 2010, doi: 10.1109/TMC.2010.28.

Künzel, Gustavo, Gustavo PedrosoCainelli, Ivan Müller, and Carlos Eduardo Pereira. "Weight adjustments in a routing algorithm for wireless sensor and actuator networks using Q-learning." IFAC-PapersOnLine 51, no. 10: 58-63. (2018).




DOI (PDF): https://doi.org/10.20508/ijrer.v13i1.13684.g8684

Refbacks

  • There are currently no refbacks.


Online ISSN: 1309-0127

Publisher: Gazi University

IJRER is cited in SCOPUS, EBSCO, WEB of SCIENCE (Clarivate Analytics);

IJRER has been cited in Emerging Sources Citation Index from 2016 in web of science.

WEB of SCIENCE in 2025; 

h=35,

Average citation per item=6.59

Last three Years Impact Factor=(1947+1753+1586)/(146+201+78)=5286/425=12.43

Category Quartile:Q4