Book contents
- Frontmatter
- Contents
- Contributors
- Acknowledgments
- 1 The Probability Distribution of the Age of Information
- 2 On the Distribution of AoI
- 3 Multisource Queueing Models
- 4 Controlling the Age of Information: Buffer Size, Deadlines, and Packet Management
- 5 Timely Status Updating via Packet Management in Multisource Systems
- 6 Age of Information in Source Coding
- 7 Sampling and Scheduling for Minimizing Age of Information of Multiple Sources
- 8 Age-Efficient Scheduling in Communication Networks
- 9 Age-Driven Transmission Scheduling in Wireless Networks
- 10 Age of Information and Remote Estimation
- 11 Relation between Value and Age of Information in Feedback Control
- 12 Age of Information in Practice
- 13 Reinforcement Learning for Minimizing Age of Information over Wireless Links
- 14 Information Freshness in Large-Scale Wireless Networks: A Stochastic Geometry Approach
- 15 The Age of Channel State Information
- 16 Transmission Preemption for Information Freshness Optimization
- 17 Economics of Fresh Data Trading
- 18 UAV-Assisted Status Updates
- Index
13 - Reinforcement Learning for Minimizing Age of Information over Wireless Links
Published online by Cambridge University Press: 02 February 2023
- Frontmatter
- Contents
- Contributors
- Acknowledgments
- 1 The Probability Distribution of the Age of Information
- 2 On the Distribution of AoI
- 3 Multisource Queueing Models
- 4 Controlling the Age of Information: Buffer Size, Deadlines, and Packet Management
- 5 Timely Status Updating via Packet Management in Multisource Systems
- 6 Age of Information in Source Coding
- 7 Sampling and Scheduling for Minimizing Age of Information of Multiple Sources
- 8 Age-Efficient Scheduling in Communication Networks
- 9 Age-Driven Transmission Scheduling in Wireless Networks
- 10 Age of Information and Remote Estimation
- 11 Relation between Value and Age of Information in Feedback Control
- 12 Age of Information in Practice
- 13 Reinforcement Learning for Minimizing Age of Information over Wireless Links
- 14 Information Freshness in Large-Scale Wireless Networks: A Stochastic Geometry Approach
- 15 The Age of Channel State Information
- 16 Transmission Preemption for Information Freshness Optimization
- 17 Economics of Fresh Data Trading
- 18 UAV-Assisted Status Updates
- Index
Summary
In this chapter, we study the Age of Information (AoI) when the status updates of the underlying process of interest can be sampled at any time by the source node and are transmitted over an error-prone wireless channel. We assume the availability of perfect feedback that informs the transmitter about the success or failure of transmitted status updates and consider various retransmission strategies. More specifically, we study the scheduling of sampling and transmission of status updates in order to minimize the long-term average AoI at the destination under resource constraints. We assume that the underlying statistics of the system are not known, and hence, propose average-cost reinforcement learning algorithms for practical applications. Extensions of the results to a multiuser setting with multiple receivers and to an energy-harvesting source node are also presented, different reinforcement learning methods including deep Q Network (DQN) are exploited and their performances are demonstrated.
Keywords
- Type
- Chapter
- Information
- Age of InformationFoundations and Applications, pp. 327 - 363Publisher: Cambridge University PressPrint publication year: 2023