The Underwater Acoustic Wireless Sensor Network (UAWSN) is a remote operating system that uses sensors Rx nodes to monitor natural or physical parameters for underwater scenarios. These sensors’ Rx nodes are autonomous devices and critical parts of UAWSNs. Due to the increased bit error rate and high propagation delay for the basic parameters of the physical medium in UAWSNs, conventional MAC protocols are insufficient. This research presents a Q-learning-based Energy Efficient Multi-Flow Two-Way MAC Protocol (Q-EEMFTW-MAC) for UAWSNs to address multi-flow and multi-hop data packet flows in a cooperative network environment. Our proposed Q-EEMFTW-MAC protocol allows multiple data transmission flows to operate simultaneously while being modified by variable traffic conditions. In contrast to existing underwater MAC protocols, our proposed MAC protocol provides a framework for multi-hop flows by analyzing every incoming communicating data packet in directed layer processing. During the communicating data packet flow setup, all the Tx anchor nodes within the cooperative regions should receive an acknowledgement from the neighbor nodes. The performance analysis of our proposed Q-EEMFTW-MAC is carried out through simulations by adopting/considering various variables such as network throughput, end-to-end latency energy consumption and bit error rate probability. Furthermore, our proposed protocol is compared with the existing cascading multi-flow reservation and transmission MAC protocol (CMRT) and a Q-Learning-based Adaptive MAC Protocol for UAWSNs. The experimental results showed that Q-EEMFTW-MAC can transmit up to 84.3% more data and use up to 88.6% less energy than comparable MAC protocols under the evaluated conditions. For end-to-end latency, the proposed protocol reduces packet transmission delay by 27.3%, while the Q-EEMFTW-R/N achieves a 36.3% reduction.
- Open Access
- Article
A Q-Learning-Based Energy-Efficient Multi-Flow Two-Way MAC Protocol for Un-Derwater Acoustic Sensor Networks
- Sajid Ullah Khan
Author Information
Received: 25 July 2026 | Revised: 21 September 2026 | Accepted: 30 October 2026 | Published: 09 November 2026
Abstract
Keywords
underwater acoustic wireless sensor networks | energy consumption | end-to-end latency | multi-flow two-way mac protocol | Q-learning
References
- 1.
Khan, Z.; Gang, Q.; Muhammad, A.; et al. RETRACTED: A Comprehensive Survey of Energy‑Efficient MAC and Routing Protocols for Underwater Wireless Sensor Networks. Electronics 2022, 11, 3015. https://doi.org/10.3390/electronics11193015.
- 2.
Khan, Z.U.; Aman, M.; Rahman, W.U.; et al. Machine Learning‑based Multi‑path Reliable and Energy‑efficient Routing Protocol for Underwater Wireless Sensor Networks. In Proceedings of the 2023 International Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan, 11–12 December 2023; pp. 316–321. https://doi.org/10.1109/fit60620.2023.00064.
- 3.
Narla, V.L.; Kachhoria, R.; Arun, M.; et al. IoT based energy efficient multipath power control for underwater sensor network. Int. J. Syst. Assur. Eng. Manag. 2022, 1–10.
- 4.
Mian, S.; Gang, Q.; Aman, M.; et al. A Visible Light Geometric Multilateration Based Positioning System to Localize Nodes in an UWSNs. In Proceedings of the 2023 IEEE 11th International Conference on Computer Science and Network Technology (ICCSNT), Dalian, China, 21–22 October 2023; pp. 392–396. https://doi.org/10.1109/iccsnt58790.2023.10334585.
- 5.
Alfouzan, F.A. Energy‑Efficient Collision Avoidance MAC Protocols for Underwater Sensor Networks: Survey and Challenges. J. Mar. Sci. Eng. 2021, 9, 741. https://doi.org/10.3390/jmse9070741.
- 6.
Wu, Y.; Geng, X. Overview of the MAC Protocols for Underwater Acoustic Networks. World Sci. Res. J. 2021, 7, 33–45.
- 7.
Aman, M.; Gang, Q.; Mian, S.; et al. RSSI based Trilateration Technique to Localize Nodes in Underwater Wireless Sensor Networks through Optical Communication. In Proceedings of the 2021 16th International Conference on Emerging Technologies (ICET), Islamabad, Pakistan, 22–23 December 2021; pp. 1–5. https://doi.org/10.1109/icet54505.2021.9689902.
- 8.
Fattah, S.; Gani, A.; Ahmedy, I.; et al. A Survey on Underwater Wireless Sensor Networks: Requirements, Taxonomy, Recent Advances, and Open Research Challenges. Sensors 2020, 20, 5393. https://doi.org/10.3390/s20185393.
- 9.
Chen, K.; Ma, M.; Cheng, E.; et al. A Survey on MAC Protocols for Underwater Wireless Sensor Networks. IEEE Commun. Surv. Tutorials 2014, 16, 1433–1447. https://doi.org/10.1109/surv.2014.013014.00032.
- 10.
Heidemann, J.; Ye, W.; Wills, J.; et al. Research challenges and applications for underwater sensor networking. In Proceedings of the IEEE Wireless Communications and Networking Conference, 2006, Las Vegas, NV, USA, 3–6 April 2006; pp. 228–235. https://doi.org/10.1109/wcnc.2006.1683469.
- 11.
Chirdchoo, N.; Soh, W.S.; Chua, K.C. RIPT: A Receiver‑Initiated Reservation‑Based Protocol for Underwater Acoustic Networks. IEEE J. Sel. Areas Commun. 2008, 26, 1744–1753. https://doi.org/10.1109/jsac.2008.081213.
- 12.
Ng, H.H.; Soh, W.S.; Motani, M. An underwater acoustic MAC protocol using reverse opportunistic packet appending. Comput. Netw. 2013, 57, 2733–2751. https://doi.org/10.1016/j.comnet.2013.06.007.
- 13.
Lin, W.; Chen, K. MHM: A Multiple Handshaking MAC Protocol for Underwater Acoustic Sensor Networks. Int. J. Distrib. Sens. Netw. 2016, 12, 9798075. https://doi.org/10.1155/2016/9798075.
- 14.
Lee, J.W.; Cho, H.S. A Hybrid Sender‑ and Receiver‑Initiated Protocol Scheme in Underwater Acoustic Sensor Networks. Sensors 2015, 15, 28052–28069. https://doi.org/10.3390/s151128052.
- 15.
Gazi, F.; Ahmed, N.; Misra, S.; et al. Reinforcement Learning‑Based MAC Protocol for Underwater Multimedia Sensor Networks. ACM Trans. Sens. Netw. 2022, 18, 1–25. https://doi.org/10.1145/3484201.
- 16.
Alhassan, I.B.; Mitchell, P.D. Packet Flow Based Reinforcement Learning MAC Protocol for Underwater Acoustic Sensor Networks. Sensors 2021, 21, 2284. https://doi.org/10.3390/s21072284.
- 17.
Jin, L.; Huang, D.D. A slotted CSMA based reinforcement learning approach for extending the lifetime of underwater acoustic wireless sensor networks. Comput. Commun. 2013, 36, 1094–1099. https://doi.org/10.1016/j.comcom.2012.10.007.
- 18.
Molins, M.; Stojanovic, M. Slotted FAMA: A MAC protocol for underwater acoustic networks. In Proceedings of the OCEANS 2006—Asia Pacific, Singapore, 16–19 May 2007; pp. 1–7. https://doi.org/10.1109/oceansap.2006.4393832.
- 19.
Ng, H.H.; Soh, W.S.; Motani, M. A Bidirectional‑Concurrent MAC Protocol With Packet Bursting for Underwater Acoustic Networks. IEEE J. Ocean. Eng. 2013, 38, 547–565. https://doi.org/10.1109/joe.2012.2227553.
- 20.
Lee, J.W.; Cho, H.S. Cascading Multi‑Hop Reservation and Transmission in Underwater Acoustic Sensor Networks. Sensors 2014, 14, 18390–18409. https://doi.org/10.3390/s141018390.
- 21.
Gang, Q.; Rahman, W.U.; Zhou, F.; et al. A Q‑Learning‑Based Approach to Design an Energy‑Efficient MAC Protocol for UWSNs Through Collision Avoidance. Electronics 2024, 13, 4388. https://doi.org/10.3390/electronics13224388.
- 22.
Zuberi, H.H.; Liu, S.; Bilal, M.; et al. Quadrature phase shift keying Sine chirp spread Spectrum under‑water acoustic communication based on VTRM. In Proceedings of the 2022 19th International Bhurban Conference on Applied Sciences and Technology (IBCAST), Islamabad, Pakistan, 16–20 August 2022; pp. 884–888. https://doi.org/10.1109/ibcast54850.2022.9990102.
This work is licensed under a Creative Commons Attribution 4.0 International License.
