Computing Reviews

A multi-state Q-learning based CSMA MAC protocol for wireless networks
Bayat-Yeganeh H., Shah-Mansouri V., Kebriaei H. Wireless Networks24(4):1251-1264,2018.Type:Article
Date Reviewed: 07/27/18

Carrier sense multiple access (CSMA) is a very common media access control scheme across various networking topologies and architectures. Whenever multiple agents require the use of a shared transmission medium to send data, some form of orchestration of access is required. Broadly generalized, the medium can either be partitioned or the attached agents can take turns transmitting. CSMA falls under the latter grouping of schemes. Agents first check if another agent is transmitting; if no other device is, then transmission can begin.

P-persistent CSMA is one of three variants that deal with the problem of multiple agents all starting transmission as soon as the medium is clear. Under this scheme, each agent will transmit with a probability p and defer to the next time the channel is available with probability 1-p. It should come as no surprise that the optimal value of p depends on the number of agents and how frequently they need to transmit data. In any network where either of these two parameters changes over time, it makes sense that each agent is able to adapt its value of p to the changing circumstances.

The authors use reinforcement learning to train the agents: each agent is rewarded for a successful transmission and punished for transmission collisions. All of the aforementioned topics are already extensively researched and documented. What the authors add to the state of the art is the combination of two conditions. First, no a priori knowledge of the network is assumed. Second, agents with various learning algorithms are combined to compete against each other. Performance results are realized through the use of MATLAB simulations.

Reviewer:  Bernard Kuc Review #: CR146175 (1811-0570)

Reproduction in whole or in part without permission is prohibited.   Copyright 2024 ComputingReviews.com™
Terms of Use
| Privacy Policy