Ant colony optimization; Convergence speed; Deep reinforcement learning; Smart agriculture; Unmanned ariel vehicle; Agriculture systems; Global population; Learning network; Performance; Q-learning; Reinforcement learnings; Smart agricultures; Unmanned ariel vehicles; Computer Science (all); Electrical and Electronic Engineering; General Computer Science
Abstract :
[en] As the global population continues to grow and environmental conditions become increasingly unpredictable, meeting the demands for food becomes increasingly difficult. To overcome these challenges, smart agriculture has emerged as the key technology. Deep Learning model with Internet of Things (IoT), unmanned aerial vehicle (UAV), and edge–fog–cloud architecture enabled smart agriculture as a key component for next agriculture revolution. In this work, we present two stage end-to-end DRL based smart agricultural system. In stage one, we proposed ACO enabled DQN (MACO-DQN) model to offload task including fire detection, pest detection, crop growth monitoring, irrigation scheduling, soil monitoring, climate monitoring, field monitoring etc. MACO-DQN model offload the task to either edge, fog or cloud networking devices based on latency, energy consumption and computing power. Once the task offloaded to computing devices (edge, fog or cloud), task of prediction and monitoring various agriculture activities is performed at stage two. In stage two, we proposed DRL based DQN (RL-DQN) model for prediction and monitoring agricultural task activities. Finally, we demonstrate experimental findings of our proposed model that represent a marked enhancement in terms of convergence speed, planning success rate, and path accuracy. To evaluate its performance, the method presented in this paper was compared to traditional deep Q-networks-based intensive learning method under consistent experimental conditions. Overall, 98.5% precision, 99.1% recall, 98.1% F-measure, and 98.5% accuracy is obtained when using our proposed methodology and based on the performance results the model outperforms other existing methodologies.
Disciplines :
Computer science
Author, co-author :
Devarajan, Ganesh Gopal; Department of Computer Science and Engineering, SRM Institute of Science and Technology, Delhi-NCR Campus, Modinagar, India
NAGARAJAN, Senthil Murugan ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Mathematics (DMATH)
T.V., Ramana; Computer Science and Engineering Department, Jain University, Bangalore, India
T., Vignesh; Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, India
Ghosh, Uttam; Department of Computer Science and Data Science, Meharry Medical College, United States
Alnumay, Waleed; Department of Computer Science, Riyadh Community College, King Saud University, P.O.Box 28095, Riyadh, Saudi Arabia
External co-authors :
yes
Language :
English
Title :
DDNSAS: Deep reinforcement learning based deep Q-learning network for smart agriculture system
Mann, H.H., Social Framework of Agriculture. 2021, Routledge.
Su, Y., Wang, X., Innovation of agricultural economic management in the process of constructing smart agriculture by big data. Sustain. Comput. Inf. Syst., 31, 2021, 100579.
Jones, K., Nowak, A., Berglund, E., Grinnell, W., Temu, E., Paul, B., Renwick, L.L., Steward, P., Rosenstock, T.S., Kimaro, A.A., Evidence supports the potential for climate-smart agriculture in Tanzania. Glob. Food Secur., 36, 2023, 100666.
Goel, R.K., Yadav, C.S., Vishnoi, S., Rastogi, R., Smart agriculture–Urgent need of the day in developing countries. Sustain. Comput. Inf. Syst., 30, 2021, 100512.
Sinha, A., Shrivastava, G., Kumar, P., Architecting user-centric internet of things for smart agriculture. Sustain. Comput. Inf. Syst. 23 (2019), 88–102.
Ray, P.P., Internet of things for smart agriculture: Technologies, practices and future direction. J. Amb. Intell. Smart Environ. 9:4 (2017), 395–420.
Katimbo, A., Rudnick, D.R., Zhang, J., Ge, Y., DeJonge, K.C., Franz, T.E., Shi, Y., Liang, W.-z., Qiao, X., Heeren, D.M., et al. Evaluation of artificial intelligence algorithms with sensor data assimilation in estimating crop evapotranspiration and crop water stress index for irrigation water management. Smart Agric. Technol., 2023, 100176.
Lavanya, G., Rani, C., GaneshKumar, P., An automated low cost IoT based fertilizer intimation system for smart agriculture. Sustain. Comput. Inf. Syst., 28, 2020, 100300.
Kapoor, A., Bhat, S.I., Shidnal, S., Mehra, A., Implementation of IoT (internet of things) and image processing in smart agriculture. 2016 International Conference on Computation System and Information Technology for Sustainable Solutions, CSITSS, 2016, IEEE, 21–26.
Zhang, L., Dabipi, I.K., Brown Jr., W.L., Internet of things applications for agriculture. Internet of Things A to Z: Technologies and Applications, 2018, Wiley Online Library, 507–528.
Tzounis, A., Katsoulas, N., Bartzanas, T., Kittas, C., Internet of things in agriculture, recent advances and future challenges. Biosyst. Eng. 164 (2017), 31–48.
Maddikunta, P.K.R., Hakak, S., Alazab, M., Bhattacharya, S., Gadekallu, T.R., Khan, W.Z., Pham, Q.-V., Unmanned aerial vehicles in smart agriculture: Applications, requirements, and challenges. IEEE Sens. J. 21:16 (2021), 17608–17619.
Kim, J., Kim, S., Ju, C., Son, H.I., Unmanned aerial vehicles in agriculture: A review of perspective of platform, control, and applications. Ieee Access 7 (2019), 105100–105115.
Srbinovska, M., Gavrovski, C., Dimcev, V., Krkoleva, A., Borozan, V., Environmental parameters monitoring in precision agriculture using wireless sensor networks. J. Clean. Prod. 88 (2015), 297–307.
Haule, J., Michael, K., Deployment of wireless sensor networks (WSN) in automated irrigation management and scheduling systems: a review. Proceedings of the 2nd Pan African International Conference on Science, Computing and Telecommunications, PACT 2014, 2014, IEEE, 86–91.
Zamora-Izquierdo, M.A., Santa, J., Martínez, J.A., Martínez, V., Skarmeta, A.F., Smart farming IoT platform based on edge and cloud computing. Biosyst. Eng. 177 (2019), 4–17.
Kaloxylos, A., Eigenmann, R., Teye, F., Politopoulou, Z., Wolfert, S., Shrank, C., Dillinger, M., Lampropoulou, I., Antoniou, E., Pesonen, L., et al. Farm management systems and the Future Internet era. Comput. Electron. Agric. 89 (2012), 130–144.
Sutton, R.S., Barto, A.G., Reinforcement Learning: An Introduction. 2018, MIT Press.
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al. Human-level control through deep reinforcement learning. Nature 518:7540 (2015), 529–533.
Bu, F., Wang, X., A smart agriculture IoT system based on deep reinforcement learning. Future Gener. Comput. Syst. 99 (2019), 500–507.
Zhao, J., Wang, Y., Fei, Z., Wang, X., Uav deployment design for maximizing effective data with delay constraint in a smart farm. 2020 IEEE/CIC International Conference on Communications in China, ICCC, 2020, IEEE, 424–429.
Li, B., Fei, Z., Zhang, Y., UAV communications for 5G and beyond: Recent advances and future trends. IEEE Internet Things J. 6:2 (2018), 2241–2263.
Elsayed, M., Erol-Kantarci, M., AI-enabled future wireless networks: Challenges, opportunities, and open issues. IEEE Veh. Technol. Mag. 14:3 (2019), 70–77.
Khoramnejad, F., Erol-Kantarci, M., On joint offloading and resource allocation: A double deep q-network approach. IEEE Trans. Cogn. Commun. Netw. 7:4 (2021), 1126–1141.
Akbari, M., Abedi, M.R., Joda, R., Pourghasemian, M., Mokari, N., Erol-Kantarci, M., Age of information aware VNF scheduling in industrial IoT using deep reinforcement learning. IEEE J. Sel. Areas Commun. 39:8 (2021), 2487–2500.
Lottes, P., Khanna, R., Pfeifer, J., Siegwart, R., Stachniss, C., UAV-based crop and weed classification for smart farming. 2017 IEEE International Conference on Robotics and Automation, ICRA, 2017, IEEE, 3024–3031.
Yang, Z., Pan, C., Wang, K., Shikh-Bahaei, M., Energy efficient resource allocation in UAV-enabled mobile edge computing networks. IEEE Trans. Wireless Commun. 18:9 (2019), 4576–4589.
Nguyen, A.C., Pamuklu, T., Syed, A., Kennedy, W.S., Erol-Kantarci, M., Deep reinforcement learning for task offloading in UAV-aided smart farm networks. 2022 arXiv preprint arXiv:2209.07367.
Kumar, P., Udayakumar, A., Anbarasa Kumar, A., Senthamarai Kannan, K., Krishnan, N., Multiparameter optimization system with DCNN in precision agriculture for advanced irrigation planning and scheduling based on soil moisture estimation. Environ. Monit. Assess., 195(1), 2023, 13.
Bal, F., Kayaalp, F., A novel deep learning-based hybrid method for the determination of productivity of agricultural products: Apple case study. IEEE Access 11 (2023), 7808–7821, 10.1109/ACCESS.2023.3238570.
Ong, P., Teo, K.S., Sia, C.K., UAV-based weed detection in Chinese cabbage using deep learning. Smart Agric. Technol., 2023, 100181.
Fei, S., Hassan, M.A., Xiao, Y., Su, X., Chen, Z., Cheng, Q., Duan, F., Chen, R., Ma, Y., UAV-based multi-sensor data fusion and machine learning algorithm for yield prediction in wheat. Precis. Agric. 24:1 (2023), 187–212.