Published April 10, 2022 | Version v1

Deep Reinforcement Learning for Random Access in Machine-Type Communication

  • 1. Centro Tecnológico de Telecomunicaciones de Cataluña (CTTC)
  • 2. Swiss Data Science Center

Description

Random access (RA) schemes are a topic of high interest in machine-type communication (MTC). In RA protocols, backoff techniques such as exponential backoff (EB) are used to stabilize the system to avoid low throughput and excessive delays. However, these backoff techniques show varying performance for different underlying assumptions and analytical models. Therefore, finding a better transmission policy for slotted ALOHA RA is still a challenge. In this paper, we show the potential of deep reinforcement learning (DRL) for RA. We learn a transmission policy that balances between throughput and fairness. The proposed algorithm learns transmission probabilities using previous action and binary feedback signal, and it is adaptive to different traffic arrival rates. Moreover, we propose average age of packet (AoP) as a metric to measure fairness among users. Our results show that the proposed policy outperforms the baseline EB transmission schemes in terms of throughput and fairness. © 2022 IEEE.

Notes

This work was supported by the European Union H2020 Research and Innovation Programme through Marie Sklodowska Curie action (MSCA-ITN-ETN 813999 WINDMILL) and the Spanish Ministry of Economy and Competitiveness under Project RTI2018-099722-B-I00 (ARISTIDES). © 2022, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other work.

Files

0000015872.pdf

Files (305.3 kB)

Name Size Download all
md5:209e99d1b2604383eeaf3a36c104f5ba
305.3 kB Preview Download

Additional details

Funding

European Commission
WINDMILL - Integrating wireless communication engineering and machine learning 813999